2020-01-26T15:02:48.594 INFO:root:teuthology version: 1.0.0-7063d1e 2020-01-26T15:02:48.595 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.aLmHMH.tmp -- --verbose --lock --description upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} --name sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314 2020-01-26T15:02:48.652 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:02:48.741 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314 branch: wip-sage2-testing-2020-01-24-1408 description: upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}} email: null first_in_suite: false job_id: '4709314' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/mimic latest ' name: sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi nuke-on-error: false openstack: - volumes: count: 4 size: 10 overrides: admin_socket: branch: wip-sage2-testing-2020-01-24-1408 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - missing required features max_mds: 1 mon_bind_addrvec: false mon_bind_msgr2: false sha1: 084f0502288c3898c3a27b35934ea510597b049d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 084f0502288c3898c3a27b35934ea510597b049d nuke-on-error: false thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage-testing-2020-01-26-0849 sha1: aa93311c28f80541753eb7d86d811f1316c8e0c7 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 sha1: 084f0502288c3898c3a27b35934ea510597b049d suite: upgrade:cephfs suite_branch: wip-sage-testing-2020-01-26-0849 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci suite_sha1: aa93311c28f80541753eb7d86d811f1316c8e0c7 tasks: - install: branch: mimic exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm extra_packages: - librados2 - print: '**** done installing mimic' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-whitelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon mon_bind_addrvec: false mon_bind_msgr2: false - exec: osd.0: - ceph osd set-require-min-compat-client mimic - print: '**** done ceph' - ceph-fuse: null - print: '**** done mimic client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null mon.b: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - exec: mon.a: - ceph config set global mon_warn_on_msgr2_not_enabled false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph mon enable-msgr2 - ceph versions - ceph osd dump -f json-pretty - ceph config rm global mon_warn_on_msgr2_not_enabled - ceph osd require-osd-release octopus - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs set cephfs min_compat_client octopus - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2511 2020-01-26T15:02:48.741 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa; will attempt to use it 2020-01-26T15:02:48.742 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks 2020-01-26T15:02:48.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-01-26T15:02:48.744 INFO:teuthology.task.internal:Checking packages... 2020-01-26T15:02:48.744 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash '084f0502288c3898c3a27b35934ea510597b049d' 2020-01-26T15:02:48.744 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-01-26T15:02:48.759 INFO:teuthology.task.internal:no buildpackages task found 2020-01-26T15:02:48.759 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-01-26T15:02:48.834 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-01-26T15:02:48.834 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:02:48.878 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:02:58.896 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:08.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:18.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:28.941 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:38.958 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:48.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:03:58.992 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:09.010 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:19.034 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:04:29.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2020-01-26T15:04:39.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:49.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:04:59.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:09.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:19.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:29.163 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:39.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2020-01-26T15:05:49.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:05:59.214 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:09.231 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:19.250 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:29.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:39.283 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:49.298 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:06:59.315 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2020-01-26T15:07:09.326 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314', 'machine_type': 'smithi'} 2020-01-26T15:07:09.350 DEBUG:teuthology.lock.ops:locked ubuntu@smithi042.front.sepia.ceph.com, ubuntu@smithi129.front.sepia.ceph.com, ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:07:09.432 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-26T15:07:09.655 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of ubuntu 18.04 2020-01-26T15:07:09.658 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of ubuntu 18.04 2020-01-26T15:07:09.661 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of ubuntu 18.04 2020-01-26T15:07:09.953 INFO:teuthology.orchestra.console:Power off smithi129 2020-01-26T15:07:09.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:07:09.969 INFO:teuthology.orchestra.console:Power off smithi042 2020-01-26T15:07:09.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:07:09.982 INFO:teuthology.orchestra.console:Power off smithi204 2020-01-26T15:07:09.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-01-26T15:07:09.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:09.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:10.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:14.018 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:14.026 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:14.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.341 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2020-01-26T15:07:18.354 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2020-01-26T15:07:18.358 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2020-01-26T15:07:18.442 INFO:teuthology.orchestra.console:Power on smithi042 2020-01-26T15:07:18.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:07:18.457 INFO:teuthology.orchestra.console:Power on smithi129 2020-01-26T15:07:18.457 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:07:18.466 INFO:teuthology.orchestra.console:Power on smithi204 2020-01-26T15:07:18.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-01-26T15:07:18.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:18.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:22.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:22.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:22.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:26.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:26.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:26.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-01-26T15:07:26.840 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2020-01-26T15:07:26.850 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2020-01-26T15:07:26.859 INFO:teuthology.orchestra.console:Power on for smithi129 completed 2020-01-26T15:07:26.941 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2020-01-26T15:07:26.951 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2020-01-26T15:07:26.960 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2020-01-26T15:10:13.111 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:13.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:13.171 ERROR:teuthology.orchestra.connection:Error connecting to smithi129.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception AuthenticationException: Authentication failed. 2020-01-26T15:10:22.167 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:28.195 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:31.223 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:37.271 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:40.283 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:46.331 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:49.366 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:55.383 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:10:58.422 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:04.439 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:07.484 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:13.494 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:16.539 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:20.176 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:22.553 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:31.606 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:40.666 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:11:51.793 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:11:57.794 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:03.806 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:03.816 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:09.818 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:09.828 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:15.830 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:18.267 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:18.279 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:21.843 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:21.970 INFO:teuthology.orchestra.run.smithi129:> hostname 2020-01-26T15:12:22.541 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:22.643 INFO:teuthology.orchestra.run.smithi042:> hostname 2020-01-26T15:12:22.647 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2020-01-26T15:12:22.648 INFO:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2020-01-26T15:12:22.654 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2020-01-26T15:12:22.655 INFO:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2020-01-26T15:12:22.790 INFO:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2020-01-26T15:12:22.805 INFO:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2020-01-26T15:12:22.861 INFO:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2020-01-26T15:12:22.926 INFO:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2020-01-26T15:12:22.981 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2020-01-26T15:12:22.983 DEBUG:teuthology.parallel:result is None 2020-01-26T15:12:23.204 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2020-01-26T15:12:23.204 INFO:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2020-01-26T15:12:23.254 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2020-01-26T15:12:23.254 INFO:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2020-01-26T15:12:23.327 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2020-01-26T15:12:23.383 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2020-01-26T15:12:23.442 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2020-01-26T15:12:23.502 INFO:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2020-01-26T15:12:23.563 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2020-01-26T15:12:23.565 DEBUG:teuthology.parallel:result is None 2020-01-26T15:12:24.286 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:24.296 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:30.298 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:30.308 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:36.310 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:36.320 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:12:42.322 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:42.436 INFO:teuthology.orchestra.run.smithi204:> hostname 2020-01-26T15:12:42.972 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2020-01-26T15:12:42.973 INFO:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2020-01-26T15:12:43.020 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2020-01-26T15:12:43.020 INFO:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2020-01-26T15:12:43.086 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2020-01-26T15:12:43.145 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2020-01-26T15:12:43.201 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2020-01-26T15:12:43.266 INFO:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2020-01-26T15:12:43.323 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2020-01-26T15:12:43.325 DEBUG:teuthology.parallel:result is None 2020-01-26T15:12:43.512 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2020-01-26T15:12:43.512 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:12:43.528 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2020-01-26T15:12:43.528 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:12:43.545 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2020-01-26T15:12:43.545 INFO:teuthology.lock.ops:New key found. Updating... 2020-01-26T15:12:43.561 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:12:43.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:12:43.562 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:43.684 INFO:teuthology.orchestra.run.smithi129:> true 2020-01-26T15:12:43.910 INFO:teuthology.orchestra.run.smithi129:> uname -m 2020-01-26T15:12:43.963 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2020-01-26T15:12:43.963 INFO:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2020-01-26T15:12:44.010 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Ubuntu" 2020-01-26T15:12:44.010 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:ID=ubuntu 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE=debian 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="18.04" 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:44.011 INFO:teuthology.orchestra.run.smithi129.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:44.012 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:44.012 INFO:teuthology.orchestra.run.smithi129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:44.012 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:44.012 INFO:teuthology.orchestra.run.smithi129.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:44.013 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2020-01-26T15:12:44.029 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:12:44.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:12:44.030 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:44.105 INFO:teuthology.orchestra.run.smithi042:> true 2020-01-26T15:12:44.347 INFO:teuthology.orchestra.run.smithi042:> uname -m 2020-01-26T15:12:44.392 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2020-01-26T15:12:44.392 INFO:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2020-01-26T15:12:44.440 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2020-01-26T15:12:44.440 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:44.440 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="18.04" 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:44.441 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:44.442 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:44.442 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:44.442 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:44.442 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2020-01-26T15:12:44.467 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2020-01-26T15:12:44.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:12:44.468 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:44.544 INFO:teuthology.orchestra.run.smithi204:> true 2020-01-26T15:12:44.795 INFO:teuthology.orchestra.run.smithi204:> uname -m 2020-01-26T15:12:44.843 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2020-01-26T15:12:44.843 INFO:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2020-01-26T15:12:44.891 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2020-01-26T15:12:44.891 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:44.891 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2020-01-26T15:12:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2020-01-26T15:12:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="18.04" 2020-01-26T15:12:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:44.893 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:44.893 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:44.893 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:44.893 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:44.893 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:44.894 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2020-01-26T15:12:44.919 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-01-26T15:12:44.993 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpw67UQk/tV4tl6xU12/BrwAZxVV9yVgcoBV8831YKHVGckqgbXkSU7p7g+6pi2vxVT9bLNCJ0KEvIqsLRtptNjwQHB07blXqoVgyqFa5q74Wjrp9lpsZtjvajRHIVNi5nkIUGb6IGfl+bAYm7Y/iTBvk/eQodduyLiBO/WrSFShBhBr4o6/DKHxyiAkD07WKXQ37O46XYMDqDh6aMz1ch0EijKr7mtcRVL8ERfwDNGBHiW3g+9NokLiPb0+L6M6EwW0gRTgebitKl9UZWJG6RSSx0g+v1HCp+rZ7ZVwA1Rg7fnrs7ZiGchcdgq5KMo78+iuqejmFddbRxwwmv92GN smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSbQQaUcLnqebQ9zlJRWQbpcevsXiSsG2+QhzztF/14I1ZiuA5YNu0lD1qDa3PVJbnCyRWi4eZd3GrytRXh5mFvablVARTFJtLpjSiTNG0Z3DaNWv/h7g6AE8io9MHAtHAhFRQ1RZifkUqx5oL72UlLyQBzem1TZAwQpx1EOcChLRr6LO8DxXLdwpQ3rBlpJlY8X8jUKDvzb4vu/A6/IB8aDpGk07SSSNImGuH71xyPWZumwTmNlK3w8FH6c859yyTsILTcGKovOO7aH8MQ7KkFW6rYQTv6dPS/XJ0nW8Yi54+yT7ROrzZfdOoXjVzbwnOFk45RoM9z6855EFUQ5UH smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD7le6c62AhWHANvu64I6Dz2nBzVmUkXiPVbEwAw0Dph6cn+HeTiRElLsDUOk0aqnNKeMPj9ztK9NtccoA4RWwI2OUBQi66Xewh0CXNsy+byv2BmcYarFNt5s1U4rFxpE6sZy5B+cdeQtV81wOJSRRXTdBFwqlnd3GClwDAB1/3lRdmCobaRn2/8F33553hDMNOboOD9qglJE9NiV7pXnhN29fqY1GXCPLnF73RQowHb6hDUY4Spzv1Z6W2cH/cvCdoUNitZ3iYrplRUS0CJfGrkW2ZO5nQfnPI0OS0D7hkNGeSuqdr6m55HEKd831LKD3/CovgpdnDdGDtz5YyjRC9 2020-01-26T15:12:44.993 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-26T15:12:45.064 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-01-26T15:12:45.075 INFO:teuthology.task.internal:Saving configuration 2020-01-26T15:12:45.101 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-01-26T15:12:45.110 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-01-26T15:12:45.125 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:07:09.335390', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi129.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJwYMqrKhjMkMjdQI9OxDgaQ05wCgLuj3G6YulFf30MX', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314'} 2020-01-26T15:12:45.140 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:07:09.335355', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi204.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDuvfen0EDxs6EOm+hLfAbLTk3/XysMTji8yeZA5S9eE', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314'} 2020-01-26T15:12:45.167 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-01-26 15:07:09.335375', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi042.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAXoacZ5w/X/XS5VsejMHPf5j+ObEPunPWi5OT7qxWrT', u'description': u'/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314'} 2020-01-26T15:12:45.168 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-01-26T15:12:45.177 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-01-26T15:12:45.178 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['client.0'] 2020-01-26T15:12:45.178 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['client.1'] 2020-01-26T15:12:45.178 INFO:teuthology.run_tasks:Running task console_log... 2020-01-26T15:12:45.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-01-26T15:12:45.278 INFO:teuthology.run_tasks:Running task internal.connect... 2020-01-26T15:12:45.287 INFO:teuthology.task.internal:Opening connections... 2020-01-26T15:12:45.287 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:12:45.288 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:45.362 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:12:45.362 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:45.442 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:12:45.443 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:12:45.521 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-01-26T15:12:45.530 INFO:teuthology.orchestra.run.smithi204:> uname -m 2020-01-26T15:12:45.563 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2020-01-26T15:12:45.563 INFO:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2020-01-26T15:12:45.611 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2020-01-26T15:12:45.611 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:45.611 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2020-01-26T15:12:45.611 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="18.04" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:45.612 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:45.613 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2020-01-26T15:12:45.627 INFO:teuthology.orchestra.run.smithi129:> uname -m 2020-01-26T15:12:45.646 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2020-01-26T15:12:45.646 INFO:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2020-01-26T15:12:45.695 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Ubuntu" 2020-01-26T15:12:45.695 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:ID=ubuntu 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE=debian 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="18.04" 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:45.696 INFO:teuthology.orchestra.run.smithi129.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:45.697 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:45.697 INFO:teuthology.orchestra.run.smithi129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:45.697 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:45.697 INFO:teuthology.orchestra.run.smithi129.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:45.697 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2020-01-26T15:12:45.711 INFO:teuthology.orchestra.run.smithi042:> uname -m 2020-01-26T15:12:45.723 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2020-01-26T15:12:45.724 INFO:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2020-01-26T15:12:45.773 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2020-01-26T15:12:45.773 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2020-01-26T15:12:45.773 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2020-01-26T15:12:45.773 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2020-01-26T15:12:45.773 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="18.04" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-01-26T15:12:45.774 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=bionic 2020-01-26T15:12:45.775 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=bionic 2020-01-26T15:12:45.775 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2020-01-26T15:12:45.789 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-01-26T15:12:45.805 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-01-26T15:12:45.815 INFO:teuthology.task.internal:Checking for old test directory... 2020-01-26T15:12:45.816 INFO:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:12:45.818 INFO:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:12:45.821 INFO:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2020-01-26T15:12:45.827 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-01-26T15:12:45.836 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-01-26T15:12:45.836 INFO:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:12:45.866 INFO:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:12:45.869 INFO:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2020-01-26T15:12:45.969 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-01-26T15:12:46.030 INFO:teuthology.run_tasks:Running task kernel... 2020-01-26T15:12:46.047 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.c': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2020-01-26T15:12:46.047 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-01-26T15:12:46.048 INFO:teuthology.orchestra.run.smithi129:> uname -r 2020-01-26T15:12:46.057 INFO:teuthology.orchestra.run.smithi129.stdout:4.15.0-72-generic 2020-01-26T15:12:46.057 INFO:teuthology.task.kernel:Running kernel on smithi129: 4.15.0-72-generic 2020-01-26T15:12:46.057 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2020-01-26T15:12:46.178 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get update 2020-01-26T15:12:46.440 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:12:46.455 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:12:46.521 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:12:46.846 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:12:46.868 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:12:47.004 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:12:47.210 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:12:47.242 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:12:47.291 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:12:47.292 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:12:47.292 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:12:47.314 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:12:47.338 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:12:47.377 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:12:47.386 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:12:47.387 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:12:47.404 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:12:47.427 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:12:47.429 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:12:47.430 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:12:47.506 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:12:47.545 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:12:47.560 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:12:47.561 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:12:47.561 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:12:47.562 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:12:47.566 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:12:47.566 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:12:48.332 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 7,167 kB in 2s (3,684 kB/s) 2020-01-26T15:12:49.642 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:12:49.688 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:12:49.782 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:12:50.013 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:12:50.014 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:12:50.087 INFO:teuthology.orchestra.run.smithi129.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:12:50.089 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:12:50.089 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:12:50.173 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:12:50.420 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:12:50.420 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:12:50.580 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2020-01-26T15:12:50.580 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:12:50.581 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:12:50.581 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:12:50.583 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2020-01-26T15:12:50.583 INFO:teuthology.orchestra.run.smithi129.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:12:50.583 INFO:teuthology.orchestra.run.smithi129.stdout:Recommended packages: 2020-01-26T15:12:50.583 INFO:teuthology.orchestra.run.smithi129.stdout: thermald 2020-01-26T15:12:50.614 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2020-01-26T15:12:50.614 INFO:teuthology.orchestra.run.smithi129.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:12:50.614 INFO:teuthology.orchestra.run.smithi129.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:12:50.614 INFO:teuthology.orchestra.run.smithi129.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:12:50.616 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2020-01-26T15:12:50.616 INFO:teuthology.orchestra.run.smithi129.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:12:50.795 INFO:teuthology.orchestra.run.smithi129.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:12:50.795 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:12:50.796 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:12:50.796 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:12:51.783 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:12:51.975 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:12:52.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:12:52.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:12:52.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:12:53.197 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:12:53.241 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:12:53.704 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 65.9 MB in 3s (25.2 MB/s) 2020-01-26T15:12:53.883 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:12:53.919 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:12:53.922 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:12:53.963 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:12:55.688 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:12:55.699 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:12:55.783 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:12:56.308 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:12:56.318 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:12:56.349 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:00.312 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:00.434 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:00.706 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:00.828 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:01.173 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:13:01.185 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:13:01.223 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:13:05.970 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:13:05.990 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:13:06.028 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:08.329 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:08.472 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:08.835 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:13:08.968 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:09.528 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:09.985 INFO:teuthology.orchestra.run.smithi129.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:13:09.986 INFO:teuthology.orchestra.run.smithi129.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:13:10.130 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:10.650 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:10.777 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:13:10.903 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:13:11.029 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:13:11.155 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:11.363 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:13:11.363 INFO:teuthology.orchestra.run.smithi129.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:13:26.352 INFO:teuthology.orchestra.run.smithi129.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:13:26.352 INFO:teuthology.orchestra.run.smithi129.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:13:26.372 INFO:teuthology.orchestra.run.smithi129.stdout:Generating grub configuration file ... 2020-01-26T15:13:26.685 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:13:26.725 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:13:27.067 INFO:teuthology.orchestra.run.smithi129.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:13:27.102 INFO:teuthology.orchestra.run.smithi129.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:13:28.056 INFO:teuthology.orchestra.run.smithi129.stdout:done 2020-01-26T15:13:28.461 INFO:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2020-01-26T15:13:28.483 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2020-01-26T15:13:28.483 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2020-01-26T15:13:28.483 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 15 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 4.15.0.74.76 2020-01-26T15:13:28.484 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:13:28.485 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2020-01-26T15:13:28.485 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2020-01-26T15:13:28.485 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:13:28.485 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2020-01-26T15:13:28.485 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:13:28.486 INFO:teuthology.orchestra.run.smithi204:> uname -r 2020-01-26T15:13:28.492 INFO:teuthology.orchestra.run.smithi204.stdout:4.15.0-72-generic 2020-01-26T15:13:28.492 INFO:teuthology.task.kernel:Running kernel on smithi204: 4.15.0-72-generic 2020-01-26T15:13:28.493 INFO:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2020-01-26T15:13:28.607 INFO:teuthology.orchestra.run.smithi204:> sudo apt-get update 2020-01-26T15:13:28.894 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:13:28.894 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:13:28.957 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:13:29.228 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:13:29.303 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:13:29.432 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:13:29.655 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:13:29.694 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:13:29.711 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:13:29.713 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:13:29.714 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:13:29.726 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:13:29.789 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:13:29.816 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:13:29.824 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:13:29.833 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:13:29.833 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:13:29.840 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:13:29.842 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:13:29.843 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:13:29.906 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:13:29.944 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:13:29.956 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:13:29.956 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:13:29.957 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:13:29.957 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:13:29.977 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:13:29.978 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:13:30.665 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 7,167 kB in 2s (3,867 kB/s) 2020-01-26T15:13:32.042 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:13:32.087 INFO:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:13:32.162 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:13:32.384 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2020-01-26T15:13:32.384 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2020-01-26T15:13:32.457 INFO:teuthology.orchestra.run.smithi204.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:13:32.459 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:13:32.459 INFO:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:13:32.538 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:13:32.778 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2020-01-26T15:13:32.778 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2020-01-26T15:13:32.946 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2020-01-26T15:13:32.947 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:13:32.947 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:13:32.947 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:13:32.949 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2020-01-26T15:13:32.949 INFO:teuthology.orchestra.run.smithi204.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:13:32.949 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2020-01-26T15:13:32.949 INFO:teuthology.orchestra.run.smithi204.stdout: thermald 2020-01-26T15:13:32.983 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2020-01-26T15:13:32.984 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:13:32.984 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:13:32.984 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:13:32.986 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2020-01-26T15:13:32.986 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:13:33.165 INFO:teuthology.orchestra.run.smithi204.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:13:33.165 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:13:33.165 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:13:33.165 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:13:34.177 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:13:34.369 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:13:35.284 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:13:35.284 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:13:35.284 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:13:35.601 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:13:35.635 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:13:36.107 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 65.9 MB in 3s (25.0 MB/s) 2020-01-26T15:13:36.271 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:13:36.310 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:13:36.313 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:13:36.360 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:38.094 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:13:38.107 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:13:38.208 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:38.714 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:13:38.726 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:13:38.764 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:42.422 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:42.559 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:42.859 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:42.988 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:43.293 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:13:43.303 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:13:43.357 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:13:48.195 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:13:48.216 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:13:48.253 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:50.659 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:13:50.822 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:13:51.157 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:13:51.294 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:51.821 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:52.270 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:13:52.270 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:13:52.407 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:52.900 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:53.009 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:13:53.138 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:13:53.262 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:13:53.405 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:13:53.609 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:13:53.609 INFO:teuthology.orchestra.run.smithi204.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:14:08.580 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:14:08.580 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:14:08.600 INFO:teuthology.orchestra.run.smithi204.stdout:Generating grub configuration file ... 2020-01-26T15:14:08.980 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:14:09.007 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:14:09.315 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:14:09.344 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:14:10.693 INFO:teuthology.orchestra.run.smithi204.stdout:done 2020-01-26T15:14:11.099 INFO:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2020-01-26T15:14:11.125 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2020-01-26T15:14:11.125 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2020-01-26T15:14:11.125 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2020-01-26T15:14:11.126 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2020-01-26T15:14:11.126 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 15 2020-01-26T15:14:11.126 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:14:11.126 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2020-01-26T15:14:11.127 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2020-01-26T15:14:11.127 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 4.15.0.74.76 2020-01-26T15:14:11.127 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:14:11.127 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2020-01-26T15:14:11.128 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2020-01-26T15:14:11.128 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:14:11.128 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2020-01-26T15:14:11.129 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:14:11.129 INFO:teuthology.orchestra.run.smithi042:> uname -r 2020-01-26T15:14:11.136 INFO:teuthology.orchestra.run.smithi042.stdout:4.15.0-72-generic 2020-01-26T15:14:11.137 INFO:teuthology.task.kernel:Running kernel on smithi042: 4.15.0-72-generic 2020-01-26T15:14:11.137 INFO:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2020-01-26T15:14:11.269 INFO:teuthology.orchestra.run.smithi042:> sudo apt-get update 2020-01-26T15:14:11.396 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:14:11.521 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:14:11.602 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:14:11.659 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [422 kB] 2020-01-26T15:14:11.733 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [611 kB] 2020-01-26T15:14:11.754 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [199 kB] 2020-01-26T15:14:11.758 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [18.4 kB] 2020-01-26T15:14:11.759 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [5,408 B] 2020-01-26T15:14:11.759 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [608 kB] 2020-01-26T15:14:11.779 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [634 kB] 2020-01-26T15:14:11.779 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [213 kB] 2020-01-26T15:14:11.781 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2020-01-26T15:14:11.781 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,284 B] 2020-01-26T15:14:11.905 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:14:12.030 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [632 kB] 2020-01-26T15:14:12.305 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [833 kB] 2020-01-26T15:14:12.393 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [292 kB] 2020-01-26T15:14:12.415 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [27.4 kB] 2020-01-26T15:14:12.417 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [7,356 B] 2020-01-26T15:14:12.418 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,044 kB] 2020-01-26T15:14:12.476 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,005 kB] 2020-01-26T15:14:12.511 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [322 kB] 2020-01-26T15:14:12.521 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [9,500 B] 2020-01-26T15:14:12.522 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [7,472 B] 2020-01-26T15:14:12.522 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,540 B] 2020-01-26T15:14:12.522 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,032 B] 2020-01-26T15:14:12.554 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,024 B] 2020-01-26T15:14:12.554 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [1,900 B] 2020-01-26T15:14:13.045 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 7,167 kB in 2s (4,583 kB/s) 2020-01-26T15:14:14.418 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:14:14.464 INFO:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:14:14.540 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:14:14.771 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2020-01-26T15:14:14.772 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2020-01-26T15:14:14.853 INFO:teuthology.orchestra.run.smithi042.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:14:14.855 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:14:14.855 INFO:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:14:14.935 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:14:15.165 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2020-01-26T15:14:15.165 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2020-01-26T15:14:15.342 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2020-01-26T15:14:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:14:15.342 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-generic linux-image-4.15.0-74-generic 2020-01-26T15:14:15.343 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-4.15.0-74-generic linux-modules-extra-4.15.0-74-generic 2020-01-26T15:14:15.344 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2020-01-26T15:14:15.344 INFO:teuthology.orchestra.run.smithi042.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-01-26T15:14:15.345 INFO:teuthology.orchestra.run.smithi042.stdout:Recommended packages: 2020-01-26T15:14:15.345 INFO:teuthology.orchestra.run.smithi042.stdout: thermald 2020-01-26T15:14:15.377 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2020-01-26T15:14:15.377 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-4.15.0-74 linux-headers-4.15.0-74-generic 2020-01-26T15:14:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: linux-image-4.15.0-74-generic linux-modules-4.15.0-74-generic 2020-01-26T15:14:15.378 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-extra-4.15.0-74-generic 2020-01-26T15:14:15.379 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages will be upgraded: 2020-01-26T15:14:15.380 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-generic linux-image-generic 2020-01-26T15:14:15.561 INFO:teuthology.orchestra.run.smithi042.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:14:15.561 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 65.9 MB of archives. 2020-01-26T15:14:15.561 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 332 MB of additional disk space will be used. 2020-01-26T15:14:15.562 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-74-generic amd64 4.15.0-74.84 [13.0 MB] 2020-01-26T15:14:16.597 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-74-generic amd64 4.15.0-74.84 [7,993 kB] 2020-01-26T15:14:16.795 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-74-generic amd64 4.15.0-74.84 [32.7 MB] 2020-01-26T15:14:17.760 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.74.76 [1,864 B] 2020-01-26T15:14:17.760 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.74.76 [2,388 B] 2020-01-26T15:14:17.760 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74 all 4.15.0-74.84 [11.0 MB] 2020-01-26T15:14:18.068 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-74-generic amd64 4.15.0-74.84 [1,122 kB] 2020-01-26T15:14:18.084 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.74.76 [2,348 B] 2020-01-26T15:14:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 65.9 MB in 3s (24.5 MB/s) 2020-01-26T15:14:18.774 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-4.15.0-74-generic. 2020-01-26T15:14:18.813 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2020-01-26T15:14:18.816 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../0-linux-modules-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:14:18.862 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:20.679 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-image-4.15.0-74-generic. 2020-01-26T15:14:20.694 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../1-linux-image-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:14:20.797 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:21.282 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-74-generic. 2020-01-26T15:14:21.294 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:14:21.324 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:25.031 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../3-linux-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:14:25.152 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:14:25.575 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:14:25.697 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:14:26.026 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-4.15.0-74. 2020-01-26T15:14:26.039 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../5-linux-headers-4.15.0-74_4.15.0-74.84_all.deb ... 2020-01-26T15:14:26.083 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:14:30.912 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-4.15.0-74-generic. 2020-01-26T15:14:30.932 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../6-linux-headers-4.15.0-74-generic_4.15.0-74.84_amd64.deb ... 2020-01-26T15:14:30.960 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:33.470 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.74.76_amd64.deb ... 2020-01-26T15:14:33.593 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-generic (4.15.0.74.76) over (4.15.0.72.74) ... 2020-01-26T15:14:33.919 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-4.15.0-74 (4.15.0-74.84) ... 2020-01-26T15:14:34.048 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:34.600 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:35.059 INFO:teuthology.orchestra.run.smithi042.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:14:35.059 INFO:teuthology.orchestra.run.smithi042.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-74-generic 2020-01-26T15:14:35.194 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-extra-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:35.696 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:35.797 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-generic (4.15.0.74.76) ... 2020-01-26T15:14:35.923 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-generic (4.15.0.74.76) ... 2020-01-26T15:14:36.049 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-generic (4.15.0.74.76) ... 2020-01-26T15:14:36.175 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for linux-image-4.15.0-74-generic (4.15.0-74.84) ... 2020-01-26T15:14:36.390 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-01-26T15:14:36.390 INFO:teuthology.orchestra.run.smithi042.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:14:52.102 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-01-26T15:14:52.103 INFO:teuthology.orchestra.run.smithi042.stdout:Sourcing file `/etc/default/grub' 2020-01-26T15:14:52.127 INFO:teuthology.orchestra.run.smithi042.stdout:Generating grub configuration file ... 2020-01-26T15:14:52.427 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:14:52.472 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:14:52.780 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:14:52.811 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:14:54.118 INFO:teuthology.orchestra.run.smithi042.stdout:done 2020-01-26T15:14:54.524 INFO:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 15 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:14:54.548 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 4.15.0.74.76 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:14:54.549 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2020-01-26T15:14:54.550 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-72-generic Expected: 4.15.0-74-generic 2020-01-26T15:14:54.550 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-01-26T15:14:54.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:14:54.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:14:54.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-01-26T15:14:54.550 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-01-26T15:14:54.551 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:14:54.551 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get clean 2020-01-26T15:14:54.710 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get update 2020-01-26T15:14:54.839 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:14:54.957 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:14:55.038 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:14:55.314 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:14:55.577 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 163 kB in 1s (235 kB/s) 2020-01-26T15:14:56.772 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:14:56.819 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:14:56.916 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:14:57.145 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:14:57.146 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:14:57.220 INFO:teuthology.orchestra.run.smithi129.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:14:57.221 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:14:57.221 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:14:57.313 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:14:57.551 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:14:57.551 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:14:57.735 INFO:teuthology.orchestra.run.smithi129.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:14:57.735 INFO:teuthology.orchestra.run.smithi129.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:14:57.736 INFO:teuthology.orchestra.run.smithi129:> dpkg -s linux-image-generic 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Package: linux-image-generic 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Status: install ok installed 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Priority: optional 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Section: kernel 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Installed-Size: 15 2020-01-26T15:14:57.760 INFO:teuthology.orchestra.run.smithi129.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: amd64 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Source: linux-meta 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Version: 4.15.0.74.76 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Recommends: thermald 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout:Description: Generic Linux kernel image 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:14:57.761 INFO:teuthology.orchestra.run.smithi129.stdout: available. 2020-01-26T15:14:57.762 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:14:57.804 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.SYyP1f5LnQ 2020-01-26T15:14:57.804 INFO:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SYyP1f5LnQ 2020-01-26T15:14:57.861 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.SYyP1f5LnQ 2020-01-26T15:14:57.979 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.SYyP1f5LnQ is 8KB 2020-01-26T15:14:58.031 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.SYyP1f5LnQ 2020-01-26T15:14:58.036 INFO:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:14:58.090 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:14:58.190 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:14:58.190 INFO:teuthology.orchestra.run.smithi129:> sudo update-grub 2020-01-26T15:14:59.387 INFO:teuthology.orchestra.run.smithi129.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:14:59.409 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2020-01-26T15:14:59.642 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:14:59.654 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:15:00.015 INFO:teuthology.orchestra.run.smithi129.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:15:00.028 INFO:teuthology.orchestra.run.smithi129.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:15:00.696 INFO:teuthology.orchestra.run.smithi129.stderr:done 2020-01-26T15:15:00.697 INFO:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2020-01-26T15:15:00.699 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2020-01-26T15:15:00.700 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:15:00.700 INFO:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2020-01-26T15:15:00.761 INFO:teuthology.orchestra.run.smithi042:> sudo apt-get update 2020-01-26T15:15:01.031 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:15:01.031 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:15:01.100 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:15:01.180 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:15:01.659 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 88.7 kB in 1s (120 kB/s) 2020-01-26T15:15:02.860 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:15:02.901 INFO:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:15:02.976 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:15:03.220 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2020-01-26T15:15:03.220 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2020-01-26T15:15:03.306 INFO:teuthology.orchestra.run.smithi042.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:15:03.307 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:15:03.308 INFO:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:15:03.389 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:15:03.618 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2020-01-26T15:15:03.618 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2020-01-26T15:15:03.816 INFO:teuthology.orchestra.run.smithi042.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:15:03.816 INFO:teuthology.orchestra.run.smithi042.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:15:03.818 INFO:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2020-01-26T15:15:03.840 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2020-01-26T15:15:03.840 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2020-01-26T15:15:03.840 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 15 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2020-01-26T15:15:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 4.15.0.74.76 2020-01-26T15:15:03.842 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:15:03.842 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2020-01-26T15:15:03.842 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2020-01-26T15:15:03.842 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:15:03.842 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2020-01-26T15:15:03.843 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-01-26T15:15:03.888 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.SPwWwDb3v9 2020-01-26T15:15:03.888 INFO:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SPwWwDb3v9 2020-01-26T15:15:03.943 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.SPwWwDb3v9 2020-01-26T15:15:04.055 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.SPwWwDb3v9 is 8KB 2020-01-26T15:15:04.066 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.SPwWwDb3v9 2020-01-26T15:15:04.072 INFO:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:15:04.128 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:15:04.230 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:15:04.231 INFO:teuthology.orchestra.run.smithi042:> sudo update-grub 2020-01-26T15:15:05.615 INFO:teuthology.orchestra.run.smithi042.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:15:05.620 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2020-01-26T15:15:05.851 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:15:05.861 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:15:06.155 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:15:06.169 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:15:07.114 INFO:teuthology.orchestra.run.smithi042.stderr:done 2020-01-26T15:15:07.116 INFO:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2020-01-26T15:15:07.118 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2020-01-26T15:15:07.118 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2020-01-26T15:15:07.118 INFO:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2020-01-26T15:15:07.224 INFO:teuthology.orchestra.run.smithi204:> sudo apt-get update 2020-01-26T15:15:07.348 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:15:07.463 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:15:07.544 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:15:07.627 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:15:09.158 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:15:09.195 INFO:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-01-26T15:15:09.270 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:15:09.494 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2020-01-26T15:15:09.494 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2020-01-26T15:15:09.570 INFO:teuthology.orchestra.run.smithi204.stderr:E: Unable to locate package linux-image-current-generic 2020-01-26T15:15:09.571 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-01-26T15:15:09.572 INFO:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-01-26T15:15:09.648 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:15:09.874 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2020-01-26T15:15:09.875 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2020-01-26T15:15:10.062 INFO:teuthology.orchestra.run.smithi204.stdout:linux-image-generic is already the newest version (4.15.0.74.76). 2020-01-26T15:15:10.062 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2020-01-26T15:15:10.063 INFO:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2020-01-26T15:15:10.088 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2020-01-26T15:15:10.089 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2020-01-26T15:15:10.089 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2020-01-26T15:15:10.089 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2020-01-26T15:15:10.089 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 15 2020-01-26T15:15:10.089 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2020-01-26T15:15:10.090 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2020-01-26T15:15:10.090 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2020-01-26T15:15:10.090 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 4.15.0.74.76 2020-01-26T15:15:10.090 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-4.15.0-74-generic, linux-modules-extra-4.15.0-74-generic, linux-firmware, intel-microcode, amd64-microcode 2020-01-26T15:15:10.090 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2020-01-26T15:15:10.091 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2020-01-26T15:15:10.091 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2020-01-26T15:15:10.091 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2020-01-26T15:15:10.091 INFO:teuthology.orchestra.run.smithi204:> mktemp 2020-01-26T15:15:10.136 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.k8BUSCooLl 2020-01-26T15:15:10.136 INFO:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub/grub.cfg /tmp/tmp.k8BUSCooLl 2020-01-26T15:15:10.196 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.k8BUSCooLl 2020-01-26T15:15:10.317 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.k8BUSCooLl is 8KB 2020-01-26T15:15:10.328 INFO:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.k8BUSCooLl 2020-01-26T15:15:10.334 INFO:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-01-26T15:15:10.391 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-01-26T15:15:10.487 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-74-generic 2020-01-26T15:15:10.488 INFO:teuthology.orchestra.run.smithi204:> sudo update-grub 2020-01-26T15:15:11.726 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2020-01-26T15:15:11.752 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2020-01-26T15:15:11.997 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-4.15.0-74-generic 2020-01-26T15:15:12.009 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-4.15.0-74-generic 2020-01-26T15:15:12.305 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2020-01-26T15:15:12.318 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2020-01-26T15:15:13.314 INFO:teuthology.orchestra.run.smithi204.stderr:done 2020-01-26T15:15:13.316 INFO:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2020-01-26T15:15:13.318 INFO:teuthology.misc:Re-opening connections... 2020-01-26T15:15:13.319 INFO:teuthology.misc:trying to connect to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:15:13.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:15:13.321 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:15:13.394 INFO:teuthology.orchestra.run.smithi204:> true 2020-01-26T15:15:13.794 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:15:13.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:15:13.794 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:13.796 DEBUG:teuthology.orchestra.remote:timed out 2020-01-26T15:16:13.796 DEBUG:teuthology.misc:waited 60.4772768021 2020-01-26T15:16:14.796 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:14.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:14.797 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:17.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2020-01-26T15:16:17.862 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:17.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:17.863 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:20.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:20.934 DEBUG:teuthology.misc:waited 67.6153309345 2020-01-26T15:16:21.934 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:21.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:21.935 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:24.998 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2020-01-26T15:16:24.998 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:24.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:24.999 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:28.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:28.070 DEBUG:teuthology.misc:waited 74.7514419556 2020-01-26T15:16:29.071 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:29.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:29.072 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:32.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2020-01-26T15:16:32.134 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:32.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:32.135 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:35.206 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:35.206 DEBUG:teuthology.misc:waited 81.8874678612 2020-01-26T15:16:36.207 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:36.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:36.208 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:36.209 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2020-01-26T15:16:36.209 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:36.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:36.210 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:38.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:38.278 DEBUG:teuthology.misc:waited 84.959335804 2020-01-26T15:16:39.278 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:39.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:39.279 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:39.426 INFO:teuthology.orchestra.run.smithi129:> true 2020-01-26T15:16:39.928 DEBUG:teuthology.misc:waited 86.6096830368 2020-01-26T15:16:40.929 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:40.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:40.930 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:41.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:41.350 DEBUG:teuthology.misc:waited 88.0314369202 2020-01-26T15:16:42.351 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:42.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:42.351 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:42.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-01-26T15:16:42.353 DEBUG:teuthology.misc:waited 89.0341320038 2020-01-26T15:16:43.353 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:43.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:43.354 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:43.787 INFO:teuthology.orchestra.run.smithi042:> true 2020-01-26T15:16:45.079 DEBUG:teuthology.misc:waited 91.7600839138 2020-01-26T15:16:46.080 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-01-26T15:16:46.080 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-74-generic"... 2020-01-26T15:16:46.080 INFO:teuthology.orchestra.run.smithi129:> uname -r 2020-01-26T15:16:46.086 INFO:teuthology.orchestra.run.smithi129.stdout:4.15.0-74-generic 2020-01-26T15:16:46.087 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:16:46.087 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:16:46.087 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2020-01-26T15:16:46.087 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.15.0-74-generic"... 2020-01-26T15:16:46.087 INFO:teuthology.orchestra.run.smithi042:> uname -r 2020-01-26T15:16:46.093 INFO:teuthology.orchestra.run.smithi042.stdout:4.15.0-74-generic 2020-01-26T15:16:46.094 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:16:46.094 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:16:46.094 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2020-01-26T15:16:46.094 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.15.0-74-generic"... 2020-01-26T15:16:46.094 INFO:teuthology.orchestra.run.smithi204:> uname -r 2020-01-26T15:16:56.330 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-01-26T15:16:56.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 696, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 184, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 428, in run r.execute() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 98, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 508, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 879, in open_session timeout=timeout, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 1006, in open_channel raise e error: [Errno 104] Connection reset by peer 2020-01-26T15:16:57.332 INFO:teuthology.misc:Re-opening connections... 2020-01-26T15:16:57.333 INFO:teuthology.misc:trying to connect to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:16:57.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:57.333 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:57.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2020-01-26T15:16:57.335 INFO:teuthology.misc:trying to connect to ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:16:57.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:57.337 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:57.415 INFO:teuthology.orchestra.run.smithi129:> true 2020-01-26T15:16:57.655 DEBUG:teuthology.misc:waited 0.321851968765 2020-01-26T15:16:58.655 INFO:teuthology.misc:trying to connect to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:16:58.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:58.656 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:58.657 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2020-01-26T15:16:58.657 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:16:58.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:16:58.659 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:16:58.728 INFO:teuthology.orchestra.run.smithi042:> true 2020-01-26T15:16:59.003 DEBUG:teuthology.misc:waited 1.66987204552 2020-01-26T15:17:00.004 INFO:teuthology.misc:trying to connect to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:17:00.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:17:00.005 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:17:00.008 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2020-01-26T15:17:00.008 DEBUG:teuthology.misc:waited 2.67565894127 2020-01-26T15:17:01.009 INFO:teuthology.misc:trying to connect to ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:17:01.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:17:01.010 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:17:01.390 INFO:teuthology.orchestra.run.smithi204:> true 2020-01-26T15:17:02.553 DEBUG:teuthology.misc:waited 5.22033810616 2020-01-26T15:17:03.554 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2020-01-26T15:17:03.554 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.15.0-74-generic"... 2020-01-26T15:17:03.554 INFO:teuthology.orchestra.run.smithi204:> uname -r 2020-01-26T15:17:03.561 INFO:teuthology.orchestra.run.smithi204.stdout:4.15.0-74-generic 2020-01-26T15:17:03.561 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-74-generic vs 4.15.0-74-generic 2020-01-26T15:17:03.561 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-01-26T15:17:04.561 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-01-26T15:17:04.562 INFO:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:17:04.594 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2020-01-26T15:17:04.611 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2020-01-26T15:17:04.611 INFO:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:17:04.642 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2020-01-26T15:17:04.668 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2020-01-26T15:17:04.668 INFO:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-01-26T15:17:04.760 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2020-01-26T15:17:04.785 INFO:teuthology.run_tasks:Running task internal.base... 2020-01-26T15:17:04.794 INFO:teuthology.task.internal:Creating test directory... 2020-01-26T15:17:04.794 INFO:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:17:04.797 INFO:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:17:04.799 INFO:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-01-26T15:17:04.805 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-01-26T15:17:04.815 INFO:teuthology.run_tasks:Running task internal.archive... 2020-01-26T15:17:04.849 INFO:teuthology.task.internal:Creating archive directory... 2020-01-26T15:17:04.849 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:17:04.852 INFO:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:17:04.854 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-01-26T15:17:04.870 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-01-26T15:17:04.941 INFO:teuthology.task.internal:Enabling coredump saving... 2020-01-26T15:17:04.941 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:17:04.943 INFO:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:17:04.945 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-01-26T15:17:04.957 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.959 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.966 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.968 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.980 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.990 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-01-26T15:17:04.992 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-01-26T15:17:05.001 INFO:teuthology.task.internal:Configuring sudo... 2020-01-26T15:17:05.001 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:17:05.011 INFO:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:17:05.014 INFO:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-01-26T15:17:05.048 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-01-26T15:17:05.058 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-01-26T15:17:05.058 INFO:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:17:05.067 INFO:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:17:05.070 INFO:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-01-26T15:17:05.096 INFO:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:17:05.145 INFO:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:17:05.197 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:17:05.285 INFO:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:17:05.292 INFO:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:17:05.339 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:17:05.427 INFO:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-01-26T15:17:05.434 INFO:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-01-26T15:17:05.484 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-01-26T15:17:05.572 INFO:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2020-01-26T15:17:05.615 INFO:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2020-01-26T15:17:05.617 INFO:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2020-01-26T15:17:05.725 INFO:teuthology.run_tasks:Running task internal.timer... 2020-01-26T15:17:05.737 INFO:teuthology.task.internal:Starting timer... 2020-01-26T15:17:05.737 INFO:teuthology.run_tasks:Running task pcp... 2020-01-26T15:17:05.772 INFO:teuthology.run_tasks:Running task selinux... 2020-01-26T15:17:05.791 DEBUG:teuthology.task.selinux:Excluding smithi204: OS 'ubuntu' does not support SELinux 2020-01-26T15:17:05.791 DEBUG:teuthology.task.selinux:Excluding smithi129: OS 'ubuntu' does not support SELinux 2020-01-26T15:17:05.791 DEBUG:teuthology.task.selinux:Excluding smithi042: OS 'ubuntu' does not support SELinux 2020-01-26T15:17:05.791 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-01-26T15:17:05.791 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-01-26T15:17:05.791 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-01-26T15:17:05.791 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-01-26T15:17:05.801 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-01-26T15:17:05.801 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-01-26T15:17:05.817 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-01-26T15:17:05.819 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi204.front.sepia.ceph.com,smithi129.front.sepia.ceph.com,smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-01-26T15:17:06.169 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-01-26T15:17:07.278 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-01-26T15:17:09.895 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-01-26T15:17:09.917 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:09 +0000 (0:00:00.059) 0:00:00.060 ******** 2020-01-26T15:17:09.927 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:09 +0000 (0:00:00.010) 0:00:00.070 ******** 2020-01-26T15:17:09.938 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:09 +0000 (0:00:00.010) 0:00:00.080 ******** 2020-01-26T15:17:12.523 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi204.front.sepia.ceph.com] 2020-01-26T15:17:12.609 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:02.671) 0:00:02.752 ******** 2020-01-26T15:17:12.629 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] 2020-01-26T15:17:12.684 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] 2020-01-26T15:17:12.762 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:00.153) 0:00:02.905 ******** 2020-01-26T15:17:12.811 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:00.048) 0:00:02.954 ******** 2020-01-26T15:17:12.878 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-01-26T15:17:12.879 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:17:12.880 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:17:12.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:00.109) 0:00:03.063 ******** 2020-01-26T15:17:12.956 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:00.035) 0:00:03.099 ******** 2020-01-26T15:17:12.961 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:17:13.000 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:12 +0000 (0:00:00.043) 0:00:03.143 ******** 2020-01-26T15:17:13.410 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-01-26T15:17:13.410 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:17:13.413 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:17:13.453 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:13 +0000 (0:00:00.453) 0:00:03.596 ******** 2020-01-26T15:17:13.487 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:13 +0000 (0:00:00.033) 0:00:03.629 ******** 2020-01-26T15:17:13.492 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-01-26T15:17:13.532 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:13 +0000 (0:00:00.045) 0:00:03.675 ******** 2020-01-26T15:17:13.806 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-01-26T15:17:13.807 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.078309", "end": "2020-01-26 15:17:13.758679", "rc": 0, "start": "2020-01-26 15:17:13.680370", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:17:13.808 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.076362", "end": "2020-01-26 15:17:13.785597", "rc": 0, "start": "2020-01-26 15:17:13.709235", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:17:13.845 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:13 +0000 (0:00:00.313) 0:00:03.988 ******** 2020-01-26T15:17:13.880 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:13 +0000 (0:00:00.033) 0:00:04.022 ******** 2020-01-26T15:17:14.063 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.324859", "end": "2020-01-26 15:17:14.053321", "rc": 0, "start": "2020-01-26 15:17:13.728462", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-01-26T15:17:14.103 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.222) 0:00:04.245 ******** 2020-01-26T15:17:14.107 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-01-26T15:17:14.108 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:14.109 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:14.150 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.047) 0:00:04.293 ******** 2020-01-26T15:17:14.183 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.032) 0:00:04.326 ******** 2020-01-26T15:17:14.230 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:14.268 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.085) 0:00:04.411 ******** 2020-01-26T15:17:14.868 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-01-26T15:17:14.869 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051834.2-223895605964858/source", "state": "file", "uid": 0} 2020-01-26T15:17:14.871 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051834.16-280159886531790/source", "state": "file", "uid": 0} 2020-01-26T15:17:14.878 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051834.28-210806294518381/source", "state": "file", "uid": 0} 2020-01-26T15:17:14.916 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.647) 0:00:05.059 ******** 2020-01-26T15:17:14.952 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.034) 0:00:05.093 ******** 2020-01-26T15:17:14.985 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:14 +0000 (0:00:00.034) 0:00:05.127 ******** 2020-01-26T15:17:15.241 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-01-26T15:17:15.243 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-26T15:17:15.286 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-01-26T15:17:15.288 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-01-26T15:17:15.289 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-01-26T15:17:15.291 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-01-26T15:17:15.510 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched PLAY [testnodes] *************************************************************** 2020-01-26T15:17:15.709 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:15 +0000 (0:00:00.724) 0:00:05.851 ******** 2020-01-26T15:17:15.750 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:15 +0000 (0:00:00.040) 0:00:05.892 ******** 2020-01-26T15:17:15.751 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:15.788 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:15 +0000 (0:00:00.038) 0:00:05.931 ******** 2020-01-26T15:17:16.464 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi042.front.sepia.ceph.com] 2020-01-26T15:17:16.524 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] 2020-01-26T15:17:16.536 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] 2020-01-26T15:17:16.585 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-01-26T15:17:16.586 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:16 +0000 (0:00:00.796) 0:00:06.728 ******** 2020-01-26T15:17:16.690 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:16 +0000 (0:00:00.104) 0:00:06.833 ******** 2020-01-26T15:17:16.729 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:16 +0000 (0:00:00.039) 0:00:06.872 ******** 2020-01-26T15:17:16.920 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-01-26T15:17:16.922 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.205771", "end": "2020-01-26 15:17:16.901931", "rc": 0, "start": "2020-01-26 15:17:16.696160", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:17:16.961 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:16 +0000 (0:00:00.231) 0:00:07.104 ******** 2020-01-26T15:17:17.051 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.217459", "end": "2020-01-26 15:17:17.025672", "rc": 0, "start": "2020-01-26 15:17:16.808213", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:17:17.089 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.128) 0:00:07.232 ******** 2020-01-26T15:17:17.096 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.205873", "end": "2020-01-26 15:17:17.052104", "rc": 0, "start": "2020-01-26 15:17:16.846231", "stderr": "", "stderr_lines": [], "stdout": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "stdout_lines": ["18e9b29cc5746d2d70d31eb50513efa350c4d3f4"]} 2020-01-26T15:17:17.135 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.045) 0:00:07.278 ******** 2020-01-26T15:17:17.140 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-26T15:17:17.141 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012575", "end": "2020-01-26 15:17:17.082207", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:17:17.069632", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:17:17.187 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.052) 0:00:07.330 ******** 2020-01-26T15:17:17.213 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-26T15:17:17.213 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.250 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.062) 0:00:07.393 ******** 2020-01-26T15:17:17.256 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-26T15:17:17.257 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013478", "end": "2020-01-26 15:17:17.183614", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:17:17.170136", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:17:17.301 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.050) 0:00:07.443 ******** 2020-01-26T15:17:17.305 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-01-26T15:17:17.306 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-01-26T15:17:17.308 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016453", "end": "2020-01-26 15:17:17.285038", "failed_when_result": false, "rc": 0, "start": "2020-01-26 15:17:17.268585", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2020-01-26T15:17:17.347 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.046) 0:00:07.490 ******** 2020-01-26T15:17:17.386 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.038) 0:00:07.529 ******** 2020-01-26T15:17:17.392 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-26T15:17:17.394 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.434 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.048) 0:00:07.577 ******** 2020-01-26T15:17:17.472 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.037) 0:00:07.614 ******** 2020-01-26T15:17:17.477 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-01-26T15:17:17.478 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.517 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.045) 0:00:07.659 ******** 2020-01-26T15:17:17.552 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.035) 0:00:07.695 ******** 2020-01-26T15:17:17.556 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-01-26T15:17:17.557 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.558 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.598 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.046) 0:00:07.741 ******** 2020-01-26T15:17:17.634 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.035) 0:00:07.777 ******** 2020-01-26T15:17:17.642 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.681 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.046) 0:00:07.823 ******** 2020-01-26T15:17:17.685 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-01-26T15:17:17.686 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.728 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.046) 0:00:07.870 ******** 2020-01-26T15:17:17.732 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.733 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-26T15:17:17.734 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:17.773 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.045) 0:00:07.916 ******** 2020-01-26T15:17:17.808 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.034) 0:00:07.951 ******** 2020-01-26T15:17:17.813 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-01-26T15:17:17.814 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.855 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.047) 0:00:07.998 ******** 2020-01-26T15:17:17.860 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.901 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.046) 0:00:08.044 ******** 2020-01-26T15:17:17.906 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-01-26T15:17:17.908 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.965 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:17 +0000 (0:00:00.063) 0:00:08.108 ******** 2020-01-26T15:17:17.970 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:17.971 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:17.972 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:17:18.013 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:18 +0000 (0:00:00.047) 0:00:08.155 ******** 2020-01-26T15:17:18.091 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:17:18.103 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-01-26T15:17:18.104 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:18.144 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:18 +0000 (0:00:00.131) 0:00:08.287 ******** 2020-01-26T15:17:18.149 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:17:18.191 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:18 +0000 (0:00:00.046) 0:00:08.333 ******** 2020-01-26T15:17:18.226 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:18.226 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:17:18.322 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:17:18.354 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:17:18.366 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-01-26T15:17:18.463 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:17:18.486 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:17:18.518 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-01-26T15:17:18.582 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:17:18.641 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:17:18.647 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-01-26T15:17:18.721 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:17:18.765 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:17:18.788 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-01-26T15:17:18.853 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:17:18.897 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:17:18.929 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-01-26T15:17:18.983 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:17:19.026 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:17:19.080 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-01-26T15:17:19.119 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:17:19.156 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:17:19.223 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-01-26T15:17:19.245 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:17:19.289 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:17:19.340 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-01-26T15:17:19.384 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:17:19.430 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:17:19.484 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-01-26T15:17:19.507 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:17:19.561 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-26T15:17:19.626 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-01-26T15:17:19.639 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:17:19.693 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:17:19.771 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-01-26T15:17:19.785 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:17:19.840 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:17:19.915 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-26T15:17:19.927 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-01-26T15:17:19.970 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:17:20.057 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:17:20.058 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-01-26T15:17:20.091 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:17:20.186 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:17:20.208 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-01-26T15:17:20.231 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:17:20.326 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:17:20.338 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-01-26T15:17:20.361 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:17:20.456 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:17:20.494 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-01-26T15:17:20.497 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:17:20.582 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:17:20.636 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:17:20.637 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-01-26T15:17:20.741 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:17:20.765 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:17:20.787 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-01-26T15:17:20.851 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:17:20.898 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:17:20.931 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-01-26T15:17:20.974 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:17:21.027 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:17:21.086 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-01-26T15:17:21.113 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:17:21.177 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:17:21.219 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-01-26T15:17:21.252 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:17:21.310 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:17:21.365 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-01-26T15:17:21.376 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:17:21.440 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:17:21.504 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:17:21.516 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-01-26T15:17:21.572 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:17:21.636 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:17:21.669 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-01-26T15:17:21.712 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:17:21.769 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:17:21.813 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-01-26T15:17:21.847 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:17:21.890 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:17:21.967 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-01-26T15:17:21.979 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:17:22.024 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:17:22.103 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-01-26T15:17:22.116 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:17:22.175 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:17:22.240 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-01-26T15:17:22.252 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:17:22.296 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:17:22.384 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:17:22.417 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-01-26T15:17:22.439 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:17:22.514 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:17:22.564 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-01-26T15:17:22.575 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:17:22.656 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:17:22.699 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-01-26T15:17:22.711 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:17:22.785 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:17:22.849 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-01-26T15:17:22.851 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:17:22.935 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:17:22.980 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-01-26T15:17:22.981 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:17:23.092 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:23.114 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-01-26T15:17:23.171 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:17:23.232 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:17:23.271 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-01-26T15:17:23.313 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:17:23.378 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:17:23.423 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-01-26T15:17:23.447 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:23.513 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:17:23.580 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:17:23.582 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-01-26T15:17:23.649 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-26T15:17:23.719 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:17:23.732 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-01-26T15:17:23.782 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:17:23.836 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:17:23.858 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:23.921 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:17:23.977 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-26T15:17:23.990 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-01-26T15:17:24.048 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:17:24.101 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:17:24.134 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-01-26T15:17:24.187 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:24.230 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:17:24.274 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-01-26T15:17:24.317 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:17:24.360 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:17:24.386 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-01-26T15:17:24.456 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:17:24.493 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:24.547 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-01-26T15:17:24.589 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:17:24.633 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:17:24.707 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-01-26T15:17:24.751 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:17:24.762 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:17:24.861 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-01-26T15:17:24.895 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:17:25.011 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:25.023 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:17:25.038 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:17:25.165 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-01-26T15:17:25.177 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-26T15:17:25.178 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:17:25.298 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-01-26T15:17:25.320 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:17:25.332 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:17:25.445 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-01-26T15:17:25.469 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:17:25.470 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:17:25.597 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:17:25.609 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:17:25.610 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-01-26T15:17:25.738 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:17:25.751 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-01-26T15:17:25.764 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:17:25.870 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:17:25.881 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:17:25.904 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-01-26T15:17:25.999 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:17:26.021 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:17:26.044 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-01-26T15:17:26.131 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:17:26.155 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:17:26.198 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-01-26T15:17:26.274 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:17:26.286 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:17:26.330 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-01-26T15:17:26.405 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:17:26.440 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:17:26.476 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-01-26T15:17:26.561 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:26.562 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:17:26.615 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-01-26T15:17:26.695 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:17:26.697 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:17:26.771 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-01-26T15:17:26.824 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:26.826 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:17:26.939 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-01-26T15:17:26.950 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:17:26.984 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:17:27.080 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:17:27.104 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-01-26T15:17:27.115 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:17:27.231 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:17:27.248 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-01-26T15:17:27.249 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:17:27.363 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:17:27.386 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-01-26T15:17:27.398 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:17:27.494 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:17:27.527 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:17:27.529 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-01-26T15:17:27.623 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:17:27.668 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-01-26T15:17:27.670 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:17:27.759 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:17:27.802 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-01-26T15:17:27.803 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:17:27.888 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:17:27.942 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-01-26T15:17:27.943 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:17:28.018 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:17:28.082 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:17:28.083 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-01-26T15:17:28.137 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:17:28.211 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:17:28.234 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-01-26T15:17:28.267 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:17:28.343 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:17:28.367 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-01-26T15:17:28.400 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:17:28.476 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:17:28.509 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-01-26T15:17:28.531 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:17:28.600 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:17:28.645 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-01-26T15:17:28.694 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:17:28.738 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:17:28.813 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:17:28.814 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-01-26T15:17:28.868 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:17:28.963 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-01-26T15:17:28.996 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:17:29.060 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:17:29.109 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-01-26T15:17:29.121 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:17:29.186 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:17:29.251 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-01-26T15:17:29.275 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:17:29.319 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:17:29.393 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-01-26T15:17:29.395 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:17:29.448 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:17:29.528 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-01-26T15:17:29.580 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:17:29.645 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:17:29.718 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:17:29.761 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-01-26T15:17:29.784 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:17:29.848 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:17:29.901 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-01-26T15:17:29.923 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:17:29.977 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:17:30.063 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:17:30.064 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-01-26T15:17:30.106 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:17:30.191 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:17:30.203 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-01-26T15:17:30.246 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:17:30.331 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-01-26T15:17:30.332 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:17:30.375 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:17:30.460 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:17:30.482 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-01-26T15:17:30.504 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:17:30.599 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:17:30.632 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-01-26T15:17:30.634 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:17:30.729 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:17:30.763 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:17:30.774 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-01-26T15:17:30.860 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-26T15:17:30.904 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:17:30.927 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-01-26T15:17:30.995 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:17:31.028 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-01-26T15:17:31.082 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-01-26T15:17:31.125 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:17:31.157 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:17:31.221 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-01-26T15:17:31.264 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:17:31.287 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:17:31.361 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-01-26T15:17:31.404 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:17:31.416 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:17:31.511 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-01-26T15:17:31.555 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:17:31.557 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:17:31.558 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:31.654 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-01-26T15:17:31.687 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:17:31.691 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:17:31.807 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-01-26T15:17:31.819 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:31.820 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:17:31.936 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-01-26T15:17:31.958 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:17:31.960 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:32.090 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:17:32.218 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:17:32.230 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-26T15:17:32.253 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-01-26T15:17:32.358 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:17:32.401 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-01-26T15:17:32.549 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-01-26T15:17:32.675 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-01-26T15:17:32.729 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:17:32.814 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-01-26T15:17:32.962 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-01-26T15:17:33.099 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:17:33.112 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-01-26T15:17:33.265 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:17:33.266 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-01-26T15:17:33.402 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-01-26T15:17:33.529 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-01-26T15:17:33.645 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:17:33.782 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:17:34.108 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:17:34.239 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-01-26T15:17:34.334 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:17:34.678 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:17:34.763 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-01-26T15:17:34.899 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:17:35.031 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:16.840) 0:00:25.174 ******** 2020-01-26T15:17:35.032 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:35.057 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:17:35.099 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:00.068) 0:00:25.242 ******** 2020-01-26T15:17:35.116 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:35.116 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:17:35.210 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:17:35.214 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:17:35.216 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:17:35.217 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:17:35.219 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:17:35.220 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:17:35.221 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:17:35.223 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:17:35.224 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-01-26T15:17:35.226 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-01-26T15:17:35.227 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c9 2020-01-26T15:17:35.233 INFO:teuthology.task.ansible.out:65228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1r 2020-01-26T15:17:35.234 INFO:teuthology.task.ansible.out:EhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:17:35.278 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:00.178) 0:00:25.421 ******** 2020-01-26T15:17:35.316 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:00.037) 0:00:25.459 ******** 2020-01-26T15:17:35.321 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:35.323 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-01-26T15:17:35.339 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:17:35.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:00.062) 0:00:25.521 ******** 2020-01-26T15:17:35.427 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:17:35.434 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:17:35.436 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:17:35.437 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:17:35.439 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:17:35.440 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:17:35.442 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:17:35.443 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:17:35.444 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, 2020-01-26T15:17:35.446 INFO:teuthology.task.ansible.out:{"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0 2020-01-26T15:17:35.447 INFO:teuthology.task.ansible.out:in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6m 2020-01-26T15:17:35.448 INFO:teuthology.task.ansible.out:IeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:17:35.491 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:35 +0000 (0:00:00.112) 0:00:25.634 ******** 2020-01-26T15:17:35.728 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:35.729 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-01-26T15:17:36.200 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-01-26T15:17:36.201 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:17:36.244 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:36 +0000 (0:00:00.753) 0:00:26.387 ******** 2020-01-26T15:17:36.251 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:36.252 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-01-26T15:17:36.254 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-01-26T15:17:36.255 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:17:36.302 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:36 +0000 (0:00:00.057) 0:00:26.445 ******** 2020-01-26T15:17:36.337 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-01-26T15:17:36.422 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:36 +0000 (0:00:00.120) 0:00:26.565 ******** 2020-01-26T15:17:36.448 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-01-26T15:17:36.492 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:36 +0000 (0:00:00.069) 0:00:26.635 ******** 2020-01-26T15:17:36.498 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:36.499 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:17:36.501 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:17:36.547 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-01-26T15:17:36.550 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-01-26T15:17:36.552 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-01-26T15:17:36.553 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-01-26T15:17:36.555 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-01-26T15:17:36.556 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-01-26T15:17:36.557 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-01-26T15:17:36.559 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-01-26T15:17:36.560 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, 2020-01-26T15:17:36.562 INFO:teuthology.task.ansible.out:{"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0 2020-01-26T15:17:36.563 INFO:teuthology.task.ansible.out:in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6m 2020-01-26T15:17:36.564 INFO:teuthology.task.ansible.out:IeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-01-26T15:17:36.604 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:36 +0000 (0:00:00.112) 0:00:26.747 ******** 2020-01-26T15:17:36.626 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:17:36.646 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:17:36.763 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:17:36.775 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:17:36.923 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:17:36.924 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:17:37.036 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:17:37.038 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:17:37.048 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:17:37.179 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:17:37.181 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:17:37.201 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:17:37.279 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-01-26T15:17:37.281 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com -> localhost] => {"after": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "attempts": 1, "before": "18e9b29cc5746d2d70d31eb50513efa350c4d3f4", "changed": false, "remote_url_changed": false} 2020-01-26T15:17:37.323 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:37 +0000 (0:00:00.718) 0:00:27.466 ******** 2020-01-26T15:17:37.329 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:37.330 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:17:37.360 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:17:37.361 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:17:37.463 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:17:37.475 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.487 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:17:37.601 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:17:37.602 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-26T15:17:37.612 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.623 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.635 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-01-26T15:17:37.636 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.638 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:17:37.648 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.768 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:17:37.790 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-01-26T15:17:37.791 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:17:37.792 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-26T15:17:37.802 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.824 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.839 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:37.904 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-26T15:17:37.905 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:17:37.946 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-01-26T15:17:37.968 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:17:38.095 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-01-26T15:17:38.096 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-01-26T15:17:38.106 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-01-26T15:17:38.108 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:17:38.156 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-26T15:17:38.240 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-26T15:17:38.255 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-01-26T15:17:38.287 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:17:38.371 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:17:38.393 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-01-26T15:17:38.395 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-01-26T15:17:38.427 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:17:38.501 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:17:38.554 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-01-26T15:17:38.555 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:17:38.640 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:17:38.682 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:17:38.704 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-01-26T15:17:38.715 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:38.779 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:17:38.832 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:17:38.864 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-01-26T15:17:38.866 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-01-26T15:17:38.875 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:38.886 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:38.887 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:38.923 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:17:38.956 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:17:38.957 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:17:39.040 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-01-26T15:17:39.072 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:17:39.074 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:17:39.188 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:17:39.189 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3 2020-01-26T15:17:39.191 INFO:teuthology.task.ansible.out:v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-01-26T15:17:39.211 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:17:39.212 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-01-26T15:17:39.233 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:17:39.338 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-01-26T15:17:39.349 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:17:39.361 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:17:39.476 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-01-26T15:17:39.488 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:17:39.490 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-26T15:17:39.500 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:17:39.636 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-01-26T15:17:39.637 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:17:39.639 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-26T15:17:39.659 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:17:39.777 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:17:39.779 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-01-26T15:17:39.800 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:17:39.900 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:17:39.944 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-01-26T15:17:39.978 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:17:40.039 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:17:40.113 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-01-26T15:17:40.125 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:17:40.177 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:17:40.262 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-01-26T15:17:40.264 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-01-26T15:17:40.284 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:17:40.306 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:17:40.416 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-26T15:17:40.418 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-26T15:17:40.438 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-01-26T15:17:40.440 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3 2020-01-26T15:17:40.441 INFO:teuthology.task.ansible.out:Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-01-26T15:17:40.567 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:17:40.569 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:17:40.592 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-01-26T15:17:40.712 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:17:40.714 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:17:40.748 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-01-26T15:17:40.833 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:17:40.846 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:17:40.889 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-01-26T15:17:40.891 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-01-26T15:17:40.975 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:17:40.997 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:17:41.019 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-01-26T15:17:41.098 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:17:41.130 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:17:41.173 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-01-26T15:17:41.228 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:17:41.281 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:17:41.324 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-01-26T15:17:41.357 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:41.416 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:41.469 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-01-26T15:17:41.501 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:17:41.544 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:17:41.609 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-01-26T15:17:41.630 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:17:41.694 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:17:41.769 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-01-26T15:17:41.770 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSS 2020-01-26T15:17:41.772 INFO:teuthology.task.ansible.out:jCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:17:41.844 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-26T15:17:41.847 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:17:41.899 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:17:41.900 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:17:41.921 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-01-26T15:17:41.976 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:17:41.978 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:17:42.031 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:17:42.053 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-01-26T15:17:42.117 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:17:42.150 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:17:42.182 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-01-26T15:17:42.248 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:17:42.288 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:17:42.342 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-01-26T15:17:42.374 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:17:42.417 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:17:42.418 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:42.490 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-01-26T15:17:42.512 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:17:42.514 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:42.555 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:17:42.556 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:17:42.558 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-26T15:17:42.640 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:17:42.641 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:17:42.643 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-26T15:17:42.651 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-01-26T15:17:42.686 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:17:42.771 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:17:42.786 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:42.819 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:17:42.904 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:17:42.915 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-01-26T15:17:42.947 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:17:43.032 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:17:43.065 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-01-26T15:17:43.097 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:17:43.161 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:17:43.214 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-01-26T15:17:43.216 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-01-26T15:17:43.226 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:17:43.300 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:17:43.353 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:17:43.364 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-01-26T15:17:43.366 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-01-26T15:17:43.439 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:17:43.495 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:17:43.528 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-01-26T15:17:43.560 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:17:43.634 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:17:43.677 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-01-26T15:17:43.699 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:17:43.773 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:17:43.775 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-26T15:17:43.827 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-01-26T15:17:43.828 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:17:43.829 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-26T15:17:43.912 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:17:43.965 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:17:43.987 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-01-26T15:17:43.988 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:44.041 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:17:44.094 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:17:44.147 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-01-26T15:17:44.149 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-01-26T15:17:44.150 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-01-26T15:17:44.170 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-26T15:17:44.171 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:17:44.244 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-26T15:17:44.245 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:17:44.285 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-01-26T15:17:44.307 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:17:44.386 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:17:44.419 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-01-26T15:17:44.430 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:17:44.546 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:17:44.558 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:17:44.560 INFO:teuthology.task.ansible.out: ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-01-26T15:17:44.675 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:17:44.698 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:44.709 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-01-26T15:17:44.802 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:44.835 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:17:44.867 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-01-26T15:17:44.962 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:17:45.004 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-01-26T15:17:45.037 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:17:45.117 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:17:45.170 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-01-26T15:17:45.182 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:17:45.246 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:17:45.299 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-01-26T15:17:45.300 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:17:45.385 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:17:45.428 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:17:45.450 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-01-26T15:17:45.451 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-01-26T15:17:45.519 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:17:45.567 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:17:45.568 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-01-26T15:17:45.653 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:17:45.696 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:17:45.718 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-01-26T15:17:45.783 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:17:45.825 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:17:45.868 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-01-26T15:17:45.869 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-01-26T15:17:45.921 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:17:45.964 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:17:45.997 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-01-26T15:17:46.050 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:17:46.082 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:17:46.145 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-01-26T15:17:46.199 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:17:46.222 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:17:46.287 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-01-26T15:17:46.321 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:17:46.353 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:17:46.439 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-01-26T15:17:46.462 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:17:46.494 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:17:46.559 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-01-26T15:17:46.602 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:17:46.623 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:17:46.697 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-01-26T15:17:46.720 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:17:46.753 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:17:46.826 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-01-26T15:17:46.848 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:17:46.896 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:17:46.971 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-01-26T15:17:46.972 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:17:47.046 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:17:47.099 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:17:47.111 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-01-26T15:17:47.197 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:17:47.240 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:17:47.241 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-01-26T15:17:47.325 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:17:47.358 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:17:47.380 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-01-26T15:17:47.454 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:17:47.498 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:17:47.499 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-01-26T15:17:47.586 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:17:47.629 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:17:47.631 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-01-26T15:17:47.715 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3W 2020-01-26T15:17:47.716 INFO:teuthology.task.ansible.out:L1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:17:47.758 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-01-26T15:17:47.759 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:17:47.760 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:17:47.844 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:17:47.846 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-26T15:17:47.897 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:17:47.898 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-01-26T15:17:47.978 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:17:47.980 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:17:48.031 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-01-26T15:17:48.043 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:17:48.112 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:17:48.166 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-01-26T15:17:48.177 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:17:48.230 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:17:48.290 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-01-26T15:17:48.312 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:17:48.366 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:17:48.441 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-01-26T15:17:48.442 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:17:48.508 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:17:48.563 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-01-26T15:17:48.565 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:17:48.632 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:17:48.700 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:17:48.701 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:48.713 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-01-26T15:17:48.769 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:17:48.828 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:17:48.829 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-01-26T15:17:48.892 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:17:48.957 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:17:48.979 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-01-26T15:17:49.023 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:17:49.086 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:17:49.108 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-01-26T15:17:49.151 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:17:49.214 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:17:49.251 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-01-26T15:17:49.279 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:17:49.342 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:17:49.395 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-01-26T15:17:49.397 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-01-26T15:17:49.407 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:17:49.470 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:17:49.534 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-01-26T15:17:49.536 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-01-26T15:17:49.548 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:17:49.602 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:17:49.669 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-01-26T15:17:49.670 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:17:49.734 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-26T15:17:49.736 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:49.800 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:17:49.842 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-01-26T15:17:49.860 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:17:49.948 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-01-26T15:17:49.950 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:49.991 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-01-26T15:17:49.992 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-26T15:17:50.081 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:17:50.114 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-01-26T15:17:50.115 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:17:50.210 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-26T15:17:50.243 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:17:50.254 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-01-26T15:17:50.350 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:17:50.372 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:17:50.404 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-01-26T15:17:50.491 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:17:50.503 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:17:50.551 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-01-26T15:17:50.615 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:17:50.636 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:17:50.695 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-01-26T15:17:50.748 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:17:50.770 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:17:50.838 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-01-26T15:17:50.879 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:50 +0000 (0:00:13.556) 0:00:41.022 ******** 2020-01-26T15:17:50.886 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:17:50.923 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:50.924 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.934 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.946 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.957 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.973 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.974 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:50.974 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-01-26T15:17:50.975 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:50.989 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.012 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.014 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:17:51.119 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:51 +0000 (0:00:00.239) 0:00:41.262 ******** 2020-01-26T15:17:51.128 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-01-26T15:17:51.130 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.131 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-26T15:17:51.132 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.157 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.168 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.180 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.199 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.201 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.202 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.212 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.223 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.245 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.246 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-01-26T15:17:51.256 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.256 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-26T15:17:51.362 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-26T15:17:51.373 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.385 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:17:51.406 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.407 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-01-26T15:17:51.501 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.502 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-26T15:17:51.514 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-26T15:17:51.515 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.526 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.537 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.538 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.538 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-01-26T15:17:51.550 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.550 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.562 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.563 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.574 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.587 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.588 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.599 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.623 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.623 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.625 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.637 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:17:51.638 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.640 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.650 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.662 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.663 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.674 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.685 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.686 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.687 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsri 2020-01-26T15:17:51.688 INFO:teuthology.task.ansible.out:vas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-01-26T15:17:51.700 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.701 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.702 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.712 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.724 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.737 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.738 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.749 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.760 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.761 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-26T15:17:51.763 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.773 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.774 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.776 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.778 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.787 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.788 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.801 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.801 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.803 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.814 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.815 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.830 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.833 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.834 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.836 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.837 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.839 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-01-26T15:17:51.849 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:51.850 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e09 2020-01-26T15:17:51.852 INFO:teuthology.task.ansible.out:7a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.862 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.863 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.864 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.874 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.875 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.876 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.887 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.898 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.899 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.900 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.912 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.914 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.915 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.916 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.926 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.927 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.928 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.939 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.940 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.941 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.951 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.951 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.962 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.963 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.964 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.974 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.975 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.977 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.987 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.987 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.989 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:51.999 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:51.999 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-01-26T15:17:52.001 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.002 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.013 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.015 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.016 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.030 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.032 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.045 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.045 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.047 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.047 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.058 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.059 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.072 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.073 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.075 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.076 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.088 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.089 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.100 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.101 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.112 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.113 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.114 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.125 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.126 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.137 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.139 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.150 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.151 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:52.152 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-01-26T15:17:52.154 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.155 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.166 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.166 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.178 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.178 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.180 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.190 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.191 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.192 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.203 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.204 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.205 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.215 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.216 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.217 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.235 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.236 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.237 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.248 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.259 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.260 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.261 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.263 INFO:teuthology.task.ansible.out: skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.264 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.265 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.276 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.288 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.289 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:52.291 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-01-26T15:17:52.292 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.294 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.295 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.305 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.306 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.317 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.317 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.319 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.329 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.330 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.332 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.343 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.344 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.345 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.356 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.356 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.367 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.369 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.389 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.390 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.392 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.441 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:52 +0000 (0:00:01.322) 0:00:42.584 ******** 2020-01-26T15:17:52.448 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.450 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.451 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.452 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-01-26T15:17:52.454 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.454 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.467 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.467 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.469 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.469 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:52.469 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.511 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:52 +0000 (0:00:00.069) 0:00:42.653 ******** 2020-01-26T15:17:52.516 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.518 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.519 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.521 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.532 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.533 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.547 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.558 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.559 INFO:teuthology.task.ansible.out: skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.570 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.571 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-01-26T15:17:52.572 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.574 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.584 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.586 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.595 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.597 INFO:teuthology.task.ansible.out: skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.607 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.609 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.683 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:52 +0000 (0:00:00.172) 0:00:42.826 ******** 2020-01-26T15:17:52.684 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.689 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.691 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi129.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-26T15:17:52.704 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.706 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-01-26T15:17:52.716 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:52.718 INFO:teuthology.task.ansible.out:TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:52.756 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:52 +0000 (0:00:00.073) 0:00:42.899 ******** 2020-01-26T15:17:52.825 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:52.826 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:17:52.848 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-01-26T15:17:52.849 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-01-26T15:17:52.920 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:52.921 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-26T15:17:52.963 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:52 +0000 (0:00:00.206) 0:00:43.106 ******** 2020-01-26T15:17:52.969 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:17:53.005 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.006 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.008 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.019 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.030 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.042 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.043 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:17:53.054 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.055 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.056 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.067 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.068 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.090 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.094 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:17:53.176 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:17:53.209 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:17:53.221 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.222 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-01-26T15:17:53.225 INFO:teuthology.task.ansible.out: skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.299 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.300 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:17:53.322 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:17:53.355 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.356 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-01-26T15:17:53.357 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:53.430 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.431 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:17:53.453 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:17:53.497 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.498 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-01-26T15:17:53.562 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.563 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:17:53.588 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:17:53.630 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.631 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-01-26T15:17:53.642 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.654 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9S 2020-01-26T15:17:53.655 INFO:teuthology.task.ansible.out:Y3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.665 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.677 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.688 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.690 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.691 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:17:53.692 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.703 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.714 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.716 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.717 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:17:53.718 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.730 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.741 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.742 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.753 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.765 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.776 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.777 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.789 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.800 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.802 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.813 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.825 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.826 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:17:53.827 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.828 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.839 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.840 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:17:53.841 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.852 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.865 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.866 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.877 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.889 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.900 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.901 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.912 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.924 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.935 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.936 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.947 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.948 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:53.950 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:17:53.960 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:53.961 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.962 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi129.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:17:53.964 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.974 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.986 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.997 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:53.998 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.010 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.021 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.022 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.033 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.044 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.056 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.058 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.070 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.081 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.083 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:54.084 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:17:54.085 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:17:54.087 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.097 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.109 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.120 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.121 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.144 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.145 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.147 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.157 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.169 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.181 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.182 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.193 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.205 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.206 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.218 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:54.218 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:17:54.220 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.231 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:54.232 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-26T15:17:54.234 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.238 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.250 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.262 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.263 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.285 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.286 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.297 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.321 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.323 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.325 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.337 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.339 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.341 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:54.343 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:17:54.345 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:54.346 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.358 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:54.359 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:17:54.361 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-01-26T15:17:54.362 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.364 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.376 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.387 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.398 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.399 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.410 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.421 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.432 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.433 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.444 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.455 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.466 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.482 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi042.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.493 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi129.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:17:54.503 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi204.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:54.576 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:54 +0000 (0:00:01.612) 0:00:44.719 ******** 2020-01-26T15:17:54.601 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-01-26T15:17:54.603 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi042.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:17:54.645 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:54 +0000 (0:00:00.067) 0:00:44.786 ******** 2020-01-26T15:17:54.649 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:17:54.740 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:17:54.764 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:17:54.817 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-01-26T15:17:54.860 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:17:54.902 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:17:54.956 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-01-26T15:17:54.990 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:17:55.022 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:17:55.094 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-01-26T15:17:55.116 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:17:55.163 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:17:55.234 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-01-26T15:17:55.243 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:17:55.283 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:17:55.370 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:17:55.389 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-01-26T15:17:55.421 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:17:55.501 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:17:55.524 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-01-26T15:17:55.561 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:17:55.641 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:17:55.663 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-01-26T15:17:55.710 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:17:55.770 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:17:55.803 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-01-26T15:17:55.836 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:17:55.900 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:17:55.942 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-01-26T15:17:55.964 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:17:56.029 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:17:56.072 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-01-26T15:17:56.084 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:17:56.147 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:17:56.200 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-01-26T15:17:56.212 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:17:56.286 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:17:56.322 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-01-26T15:17:56.340 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:17:56.424 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:17:56.446 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-01-26T15:17:56.469 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:17:56.557 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:17:56.579 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-01-26T15:17:56.601 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:17:56.680 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:17:56.692 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-01-26T15:17:56.727 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:17:56.813 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:17:56.825 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-01-26T15:17:56.857 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:17:56.946 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-01-26T15:17:56.948 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:17:57.065 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-01-26T15:17:57.076 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:17:57.192 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-01-26T15:17:57.321 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-01-26T15:17:57.447 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-01-26T15:17:57.490 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:17:57.541 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:17:57.585 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-01-26T15:17:57.621 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:17:57.685 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:17:57.717 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-01-26T15:17:57.750 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:17:57.813 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:17:57.876 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-01-26T15:17:57.904 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:17:57.942 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:17:58.005 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-01-26T15:17:58.037 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:17:58.070 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:17:58.071 INFO:teuthology.task.ansible.out: 2020-01-26T15:17:58.133 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-01-26T15:17:58.165 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:17:58.197 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:17:58.251 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-01-26T15:17:58.283 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:17:58.336 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:17:58.380 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-01-26T15:17:58.412 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-26T15:17:58.465 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-01-26T15:17:58.508 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-01-26T15:17:58.552 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:17:58.634 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:58 +0000 (0:00:03.990) 0:00:48.777 ******** 2020-01-26T15:17:58.640 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:17:58.670 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-01-26T15:17:58.709 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:58 +0000 (0:00:00.075) 0:00:48.852 ******** 2020-01-26T15:17:58.781 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-01-26T15:17:58.917 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-01-26T15:17:59.001 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-01-26T15:17:59.003 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051878.66-170409551521750/source", "state": "file", "uid": 0} 2020-01-26T15:17:59.044 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.334) 0:00:49.187 ******** 2020-01-26T15:17:59.050 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:59.050 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-01-26T15:17:59.073 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-01-26T15:17:59.074 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => { "msg": "Host smithi129.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-26T15:17:59.112 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.068) 0:00:49.255 ******** 2020-01-26T15:17:59.118 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-01-26T15:17:59.118 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051878.74-128304904196128/source", "state": "file", "uid": 0} 2020-01-26T15:17:59.162 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.049) 0:00:49.304 ******** 2020-01-26T15:17:59.167 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:17:59.169 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:17:59.209 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.047) 0:00:49.352 ******** 2020-01-26T15:17:59.222 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi042.front.sepia.ceph.com] => { "msg": "Host smithi042.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-01-26T15:17:59.255 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.045) 0:00:49.398 ******** 2020-01-26T15:17:59.261 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:17:59.262 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.052) 0:00:49.451 ******** 2020-01-26T15:17:59.313 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:17:59.315 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:17:59.356 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.047) 0:00:49.499 ******** 2020-01-26T15:17:59.362 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:17:59.364 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.405 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.047) 0:00:49.547 ******** 2020-01-26T15:17:59.410 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:17:59.412 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.450 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.044) 0:00:49.592 ******** 2020-01-26T15:17:59.455 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-26T15:17:59.456 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.495 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.045) 0:00:49.638 ******** 2020-01-26T15:17:59.501 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:17:59.503 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.540 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.044) 0:00:49.682 ******** 2020-01-26T15:17:59.545 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:17:59.546 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.585 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.045) 0:00:49.728 ******** 2020-01-26T15:17:59.590 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:59.591 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-01-26T15:17:59.592 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.631 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.046) 0:00:49.774 ******** 2020-01-26T15:17:59.636 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:17:59.638 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.676 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.044) 0:00:49.819 ******** 2020-01-26T15:17:59.681 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:17:59.683 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.721 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.044) 0:00:49.863 ******** 2020-01-26T15:17:59.726 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:17:59.726 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-01-26T15:17:59.728 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.766 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.045) 0:00:49.909 ******** 2020-01-26T15:17:59.771 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:17:59.773 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.811 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.044) 0:00:49.954 ******** 2020-01-26T15:17:59.816 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-26T15:17:59.818 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.857 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.045) 0:00:49.999 ******** 2020-01-26T15:17:59.862 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-01-26T15:17:59.863 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-01-26T15:17:59.903 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.046) 0:00:50.046 ******** 2020-01-26T15:17:59.908 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:17:59.910 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:17:59.960 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:17:59 +0000 (0:00:00.057) 0:00:50.103 ******** 2020-01-26T15:17:59.965 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-01-26T15:17:59.967 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-01-26T15:18:00.008 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.048) 0:00:50.151 ******** 2020-01-26T15:18:00.013 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-26T15:18:00.014 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.021 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.055 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.198 ******** 2020-01-26T15:18:00.060 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:18:00.062 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.101 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.045) 0:00:50.243 ******** 2020-01-26T15:18:00.105 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-26T15:18:00.107 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-01-26T15:18:00.147 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.290 ******** 2020-01-26T15:18:00.153 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-26T15:18:00.153 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.155 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.192 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.045) 0:00:50.335 ******** 2020-01-26T15:18:00.198 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-26T15:18:00.198 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.239 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.382 ******** 2020-01-26T15:18:00.246 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-01-26T15:18:00.287 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.047) 0:00:50.430 ******** 2020-01-26T15:18:00.292 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-26T15:18:00.293 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.333 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.045) 0:00:50.475 ******** 2020-01-26T15:18:00.338 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-26T15:18:00.339 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.045) 0:00:50.521 ******** 2020-01-26T15:18:00.384 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-01-26T15:18:00.384 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-01-26T15:18:00.386 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.425 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.567 ******** 2020-01-26T15:18:00.431 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-26T15:18:00.433 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.471 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.045) 0:00:50.613 ******** 2020-01-26T15:18:00.476 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-26T15:18:00.478 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.516 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.659 ******** 2020-01-26T15:18:00.526 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.563 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.047) 0:00:50.706 ******** 2020-01-26T15:18:00.569 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-26T15:18:00.569 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.610 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:50.752 ******** 2020-01-26T15:18:00.615 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-26T15:18:00.616 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:00.618 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi204.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-01-26T15:18:00.657 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.047) 0:00:50.800 ******** 2020-01-26T15:18:00.685 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-26T15:18:00.687 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.724 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.066) 0:00:50.867 ******** 2020-01-26T15:18:00.759 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.035) 0:00:50.902 ******** 2020-01-26T15:18:00.798 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.039) 0:00:50.941 ******** 2020-01-26T15:18:00.804 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-26T15:18:00.805 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.846 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.048) 0:00:50.989 ******** 2020-01-26T15:18:00.887 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.040) 0:00:51.030 ******** 2020-01-26T15:18:00.897 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.936 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.049) 0:00:51.079 ******** 2020-01-26T15:18:00.943 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-26T15:18:00.944 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:00.983 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:00 +0000 (0:00:00.046) 0:00:51.125 ******** 2020-01-26T15:18:00.988 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.028 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.045) 0:00:51.171 ******** 2020-01-26T15:18:01.034 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-26T15:18:01.035 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:01.076 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.048) 0:00:51.219 ******** 2020-01-26T15:18:01.082 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:01.125 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.048) 0:00:51.268 ******** 2020-01-26T15:18:01.131 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-26T15:18:01.133 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.174 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.049) 0:00:51.317 ******** 2020-01-26T15:18:01.180 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-01-26T15:18:01.181 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "checksum": "0568d7d0ebf10dfbba0efd326c0e510710bba26c", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b0e90762d2e927269695598309000a29", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1580051880.83-64565274842261/source", "state": "file", "uid": 0} 2020-01-26T15:18:01.182 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.221 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.046) 0:00:51.364 ******** 2020-01-26T15:18:01.260 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.038) 0:00:51.402 ******** 2020-01-26T15:18:01.265 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-26T15:18:01.267 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.309 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.049) 0:00:51.452 ******** 2020-01-26T15:18:01.351 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.041) 0:00:51.493 ******** 2020-01-26T15:18:01.357 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-01-26T15:18:01.359 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => { "msg": "Host smithi204.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [common : Store list of enabled repos] ************************************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.398 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.047) 0:00:51.541 ******** 2020-01-26T15:18:01.435 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.036) 0:00:51.578 ******** 2020-01-26T15:18:01.440 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.441 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.482 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.047) 0:00:51.625 ******** 2020-01-26T15:18:01.517 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.034) 0:00:51.660 ******** 2020-01-26T15:18:01.523 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-01-26T15:18:01.523 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-01-26T15:18:01.525 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.565 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.048) 0:00:51.708 ******** 2020-01-26T15:18:01.601 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.035) 0:00:51.743 ******** 2020-01-26T15:18:01.606 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-26T15:18:01.607 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.608 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.647 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.046) 0:00:51.790 ******** 2020-01-26T15:18:01.685 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.037) 0:00:51.827 ******** 2020-01-26T15:18:01.691 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-01-26T15:18:01.692 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:01.733 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.048) 0:00:51.876 ******** 2020-01-26T15:18:01.769 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.035) 0:00:51.911 ******** 2020-01-26T15:18:01.773 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-26T15:18:01.774 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.775 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:18:01.817 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.048) 0:00:51.959 ******** 2020-01-26T15:18:01.852 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.035) 0:00:51.995 ******** 2020-01-26T15:18:01.857 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-01-26T15:18:01.859 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.899 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.047) 0:00:52.042 ******** 2020-01-26T15:18:01.935 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.035) 0:00:52.078 ******** 2020-01-26T15:18:01.940 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-26T15:18:01.941 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:01.980 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:01 +0000 (0:00:00.044) 0:00:52.123 ******** 2020-01-26T15:18:02.015 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.035) 0:00:52.158 ******** 2020-01-26T15:18:02.023 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-01-26T15:18:02.024 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.026 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.064 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.049) 0:00:52.207 ******** 2020-01-26T15:18:02.103 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.038) 0:00:52.245 ******** 2020-01-26T15:18:02.108 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-26T15:18:02.109 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:02.110 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi042.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.151 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.048) 0:00:52.294 ******** 2020-01-26T15:18:02.187 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.036) 0:00:52.330 ******** 2020-01-26T15:18:02.193 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-01-26T15:18:02.195 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.195 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-26T15:18:02.195 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.197 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.236 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.048) 0:00:52.378 ******** 2020-01-26T15:18:02.273 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.037) 0:00:52.416 ******** 2020-01-26T15:18:02.277 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:18:02.278 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.323 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.050) 0:00:52.466 ******** 2020-01-26T15:18:02.363 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.039) 0:00:52.506 ******** 2020-01-26T15:18:02.368 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-01-26T15:18:02.368 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.370 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.371 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.412 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.049) 0:00:52.555 ******** 2020-01-26T15:18:02.449 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.036) 0:00:52.591 ******** 2020-01-26T15:18:02.454 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-26T15:18:02.456 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.496 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.047) 0:00:52.639 ******** 2020-01-26T15:18:02.502 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-01-26T15:18:02.503 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.543 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.047) 0:00:52.686 ******** 2020-01-26T15:18:02.548 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-26T15:18:02.550 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.590 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.046) 0:00:52.733 ******** 2020-01-26T15:18:02.596 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:18:02.597 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013766", "end": "2020-01-26 15:18:02.533692", "rc": 0, "start": "2020-01-26 15:18:02.519926", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:18:02.598 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.643 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.053) 0:00:52.786 ******** 2020-01-26T15:18:02.680 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.036) 0:00:52.822 ******** 2020-01-26T15:18:02.685 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-01-26T15:18:02.685 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.687 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.689 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.728 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.048) 0:00:52.871 ******** 2020-01-26T15:18:02.771 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.042) 0:00:52.914 ******** 2020-01-26T15:18:02.777 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-01-26T15:18:02.778 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.834 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.063) 0:00:52.977 ******** 2020-01-26T15:18:02.870 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.035) 0:00:53.012 ******** 2020-01-26T15:18:02.874 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-01-26T15:18:02.875 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.877 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.877 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:02.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.051) 0:00:53.063 ******** 2020-01-26T15:18:02.959 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:02 +0000 (0:00:00.038) 0:00:53.102 ******** 2020-01-26T15:18:02.965 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-01-26T15:18:02.966 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:02.967 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone] *********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.015 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.056) 0:00:53.158 ******** 2020-01-26T15:18:03.054 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.038) 0:00:53.197 ******** 2020-01-26T15:18:03.058 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-26T15:18:03.059 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.061 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.062 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.101 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.047) 0:00:53.244 ******** 2020-01-26T15:18:03.136 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.035) 0:00:53.279 ******** 2020-01-26T15:18:03.142 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-01-26T15:18:03.143 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.183 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.046) 0:00:53.326 ******** 2020-01-26T15:18:03.218 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.034) 0:00:53.360 ******** 2020-01-26T15:18:03.223 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-26T15:18:03.223 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.225 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.263 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.045) 0:00:53.406 ******** 2020-01-26T15:18:03.298 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.034) 0:00:53.440 ******** 2020-01-26T15:18:03.302 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-01-26T15:18:03.303 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.345 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.047) 0:00:53.488 ******** 2020-01-26T15:18:03.350 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-26T15:18:03.350 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.358 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.391 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.045) 0:00:53.534 ******** 2020-01-26T15:18:03.395 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-01-26T15:18:03.396 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:03.436 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.045) 0:00:53.579 ******** 2020-01-26T15:18:03.462 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-01-26T15:18:03.463 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.500 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.064) 0:00:53.643 ******** 2020-01-26T15:18:03.515 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-26T15:18:03.517 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.136416", "end": "2020-01-26 15:18:03.500346", "rc": 0, "start": "2020-01-26 15:18:03.363930", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:03.555 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.054) 0:00:53.698 ******** 2020-01-26T15:18:03.561 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-01-26T15:18:03.562 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Get the current timezone] *************************************** 2020-01-26T15:18:03.563 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013792", "end": "2020-01-26 15:18:03.512440", "rc": 0, "start": "2020-01-26 15:18:03.498648", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:18:03.607 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.051) 0:00:53.750 ******** 2020-01-26T15:18:03.644 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.036) 0:00:53.786 ******** 2020-01-26T15:18:03.648 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-26T15:18:03.648 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.650 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.690 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.046) 0:00:53.833 ******** 2020-01-26T15:18:03.727 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.035) 0:00:53.868 ******** 2020-01-26T15:18:03.731 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-01-26T15:18:03.732 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.772 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.047) 0:00:53.915 ******** 2020-01-26T15:18:03.778 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-26T15:18:03.779 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.818 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.045) 0:00:53.961 ******** 2020-01-26T15:18:03.823 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-01-26T15:18:03.824 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.864 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.045) 0:00:54.007 ******** 2020-01-26T15:18:03.868 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:18:03.870 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.908 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.044) 0:00:54.051 ******** 2020-01-26T15:18:03.913 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-01-26T15:18:03.914 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-01-26T15:18:03.915 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.054265", "end": "2020-01-26 15:18:03.855760", "rc": 0, "start": "2020-01-26 15:18:03.801495", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:03.955 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.046) 0:00:54.098 ******** 2020-01-26T15:18:03.989 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:03 +0000 (0:00:00.034) 0:00:54.132 ******** 2020-01-26T15:18:03.995 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-26T15:18:03.997 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.035 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.045) 0:00:54.178 ******** 2020-01-26T15:18:04.040 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-01-26T15:18:04.041 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.081 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.045) 0:00:54.224 ******** 2020-01-26T15:18:04.086 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-26T15:18:04.088 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.126 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.045) 0:00:54.269 ******** 2020-01-26T15:18:04.132 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-01-26T15:18:04.134 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:04.174 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.047) 0:00:54.317 ******** 2020-01-26T15:18:04.179 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-01-26T15:18:04.180 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.219 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.044) 0:00:54.362 ******** 2020-01-26T15:18:04.224 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-01-26T15:18:04.225 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.264 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.044) 0:00:54.407 ******** 2020-01-26T15:18:04.269 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-01-26T15:18:04.270 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.044) 0:00:54.451 ******** 2020-01-26T15:18:04.313 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-01-26T15:18:04.315 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.354 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.045) 0:00:54.497 ******** 2020-01-26T15:18:04.379 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-01-26T15:18:04.381 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.417 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.062) 0:00:54.560 ******** 2020-01-26T15:18:04.442 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-01-26T15:18:04.443 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.479 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.062) 0:00:54.622 ******** 2020-01-26T15:18:04.504 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-01-26T15:18:04.506 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.542 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.062) 0:00:54.685 ******** 2020-01-26T15:18:04.547 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-26T15:18:04.548 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.088124", "end": "2020-01-26 15:18:04.500368", "rc": 0, "start": "2020-01-26 15:18:04.412244", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:04.585 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.042) 0:00:54.728 ******** 2020-01-26T15:18:04.589 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-01-26T15:18:04.591 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.627 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.042) 0:00:54.770 ******** 2020-01-26T15:18:04.631 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-26T15:18:04.632 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.670 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.043) 0:00:54.813 ******** 2020-01-26T15:18:04.674 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-01-26T15:18:04.675 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:04.714 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.043) 0:00:54.856 ******** 2020-01-26T15:18:04.749 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-01-26T15:18:04.793 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.079) 0:00:54.936 ******** 2020-01-26T15:18:04.819 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-01-26T15:18:04.821 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.859 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.065) 0:00:55.002 ******** 2020-01-26T15:18:04.863 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-01-26T15:18:04.864 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.061089", "end": "2020-01-26 15:18:04.840438", "rc": 0, "start": "2020-01-26 15:18:04.779349", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:04.902 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.042) 0:00:55.045 ******** 2020-01-26T15:18:04.906 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-01-26T15:18:04.908 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.948 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:04 +0000 (0:00:00.046) 0:00:55.091 ******** 2020-01-26T15:18:04.985 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-01-26T15:18:04.987 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:04.997 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.049 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.100) 0:00:55.192 ******** 2020-01-26T15:18:05.074 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-01-26T15:18:05.076 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.087 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.124 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.075) 0:00:55.267 ******** 2020-01-26T15:18:05.160 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2020-01-26T15:18:05.161 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.162 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.200 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.076) 0:00:55.343 ******** 2020-01-26T15:18:05.226 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2020-01-26T15:18:05.228 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.265 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.065) 0:00:55.408 ******** 2020-01-26T15:18:05.302 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2020-01-26T15:18:05.303 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.304 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.348 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.082) 0:00:55.491 ******** 2020-01-26T15:18:05.489 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:18:05.491 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.017536", "end": "2020-01-26 15:18:05.462590", "rc": 0, "start": "2020-01-26 15:18:05.445054", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-01-26T15:18:05.529 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.180) 0:00:55.672 ******** 2020-01-26T15:18:05.555 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-01-26T15:18:05.557 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.594 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.065) 0:00:55.737 ******** 2020-01-26T15:18:05.620 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-01-26T15:18:05.622 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.661 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.066) 0:00:55.803 ******** 2020-01-26T15:18:05.686 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-01-26T15:18:05.688 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.726 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.065) 0:00:55.869 ******** 2020-01-26T15:18:05.751 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-01-26T15:18:05.753 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.794 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.067) 0:00:55.937 ******** 2020-01-26T15:18:05.819 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-01-26T15:18:05.821 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.859 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.064) 0:00:56.002 ******** 2020-01-26T15:18:05.884 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-01-26T15:18:05.885 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.922 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.063) 0:00:56.065 ******** 2020-01-26T15:18:05.947 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-01-26T15:18:05.949 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:05.984 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:05 +0000 (0:00:00.061) 0:00:56.127 ******** 2020-01-26T15:18:06.530 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-01-26T15:18:06.531 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.413231", "end": "2020-01-26 15:18:06.500317", "rc": 0, "start": "2020-01-26 15:18:06.087086", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:06.569 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:06 +0000 (0:00:00.584) 0:00:56.712 ******** 2020-01-26T15:18:06.595 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-01-26T15:18:06.596 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:06.640 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:06 +0000 (0:00:00.070) 0:00:56.783 ******** 2020-01-26T15:18:06.869 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-01-26T15:18:06.870 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.075953", "end": "2020-01-26 15:18:06.832484", "rc": 0, "start": "2020-01-26 15:18:06.756531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:06.912 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:06 +0000 (0:00:00.272) 0:00:57.055 ******** 2020-01-26T15:18:07.608 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-26T15:18:07.610 INFO:teuthology.task.ansible.out: [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi042.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:07.648 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:07 +0000 (0:00:00.735) 0:00:57.791 ******** 2020-01-26T15:18:08.304 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:08.305 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:08.347 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:08 +0000 (0:00:00.699) 0:00:58.490 ******** 2020-01-26T15:18:08.513 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-26T15:18:08.514 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:08.564 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:08 +0000 (0:00:00.216) 0:00:58.706 ******** 2020-01-26T15:18:08.592 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:08.593 INFO:teuthology.task.ansible.out:TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:08.636 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:08 +0000 (0:00:00.072) 0:00:58.779 ******** 2020-01-26T15:18:09.165 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-01-26T15:18:09.166 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:09.207 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:09 +0000 (0:00:00.570) 0:00:59.349 ******** 2020-01-26T15:18:09.212 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-01-26T15:18:09.213 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:18:09.253 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:09 +0000 (0:00:00.046) 0:00:59.396 ******** 2020-01-26T15:18:09.257 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-26T15:18:09.259 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:09.298 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:09 +0000 (0:00:00.045) 0:00:59.441 ******** 2020-01-26T15:18:09.607 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-01-26T15:18:09.607 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:18:09.648 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:09 +0000 (0:00:00.349) 0:00:59.791 ******** 2020-01-26T15:18:10.113 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-01-26T15:18:10.113 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:10.158 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:10 +0000 (0:00:00.509) 0:01:00.301 ******** 2020-01-26T15:18:10.164 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-01-26T15:18:10.165 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:10.205 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:10 +0000 (0:00:00.047) 0:01:00.348 ******** 2020-01-26T15:18:10.482 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-01-26T15:18:10.483 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:10.524 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:10 +0000 (0:00:00.319) 0:01:00.667 ******** 2020-01-26T15:18:10.530 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:18:10.531 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:18:10.872 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:18:10.875 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:18:11.079 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:11.120 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.592) 0:01:01.260 ******** 2020-01-26T15:18:11.143 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-01-26T15:18:11.144 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:11.188 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.070) 0:01:01.331 ******** 2020-01-26T15:18:11.195 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:18:11.196 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:18:11.200 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:18:11.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.053) 0:01:01.385 ******** 2020-01-26T15:18:11.364 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:18:11.365 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:18:11.406 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.164) 0:01:01.549 ******** 2020-01-26T15:18:11.465 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:18:11.466 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:18:11.511 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.104) 0:01:01.654 ******** 2020-01-26T15:18:11.518 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-01-26T15:18:11.519 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-01-26T15:18:11.562 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.051) 0:01:01.705 ******** 2020-01-26T15:18:11.632 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:18:11.633 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:18:11.676 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:11 +0000 (0:00:00.112) 0:01:01.818 ******** 2020-01-26T15:18:11.713 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:18:11.714 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:18:11.973 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:18:11.984 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:18:12.246 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:18:12.269 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:18:12.313 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.637) 0:01:02.456 ******** 2020-01-26T15:18:12.351 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-26T15:18:12.353 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:12.389 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.075) 0:01:02.532 ******** 2020-01-26T15:18:12.417 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:18:12.419 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.457 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.068) 0:01:02.600 ******** 2020-01-26T15:18:12.463 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-01-26T15:18:12.464 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:12.505 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.047) 0:01:02.648 ******** 2020-01-26T15:18:12.511 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-01-26T15:18:12.512 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:12.513 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi129.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:18:12.563 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.057) 0:01:02.706 ******** 2020-01-26T15:18:12.601 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.037) 0:01:02.743 ******** 2020-01-26T15:18:12.617 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:18:12.619 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.619 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.660 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.059) 0:01:02.803 ******** 2020-01-26T15:18:12.666 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-01-26T15:18:12.667 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:12.707 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.047) 0:01:02.850 ******** 2020-01-26T15:18:12.714 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:18:12.716 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.755 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.047) 0:01:02.897 ******** 2020-01-26T15:18:12.760 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:18:12.762 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.803 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.048) 0:01:02.946 ******** 2020-01-26T15:18:12.830 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:12.869 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.065) 0:01:03.012 ******** 2020-01-26T15:18:12.875 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:18:12.876 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-01-26T15:18:12.909 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:18:12.911 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.921 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.933 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:12.975 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:12 +0000 (0:00:00.103) 0:01:03.115 ******** 2020-01-26T15:18:12.998 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:18:13.000 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:13.052 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:13 +0000 (0:00:00.080) 0:01:03.195 ******** 2020-01-26T15:18:13.192 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-01-26T15:18:13.192 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-01-26T15:18:13.452 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-01-26T15:18:13.502 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:13 +0000 (0:00:00.449) 0:01:03.645 ******** 2020-01-26T15:18:13.629 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-01-26T15:18:13.631 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:18:13.671 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:13 +0000 (0:00:00.168) 0:01:03.814 ******** 2020-01-26T15:18:13.676 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-01-26T15:18:13.677 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:13.721 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:13 +0000 (0:00:00.049) 0:01:03.863 ******** 2020-01-26T15:18:13.941 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:13.989 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:13 +0000 (0:00:00.268) 0:01:04.132 ******** 2020-01-26T15:18:13.995 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:18:13.995 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-01-26T15:18:14.029 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-26T15:18:14.030 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:18:14.070 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.081) 0:01:04.213 ******** 2020-01-26T15:18:14.265 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:18:14.267 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-01-26T15:18:14.288 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-01-26T15:18:14.290 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:18:14.327 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.256) 0:01:04.469 ******** 2020-01-26T15:18:14.363 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:18:14.365 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-26T15:18:14.405 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.077) 0:01:04.547 ******** 2020-01-26T15:18:14.526 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-01-26T15:18:14.527 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-01-26T15:18:14.531 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:18:14.533 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:14.573 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.167) 0:01:04.715 ******** 2020-01-26T15:18:14.609 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.036) 0:01:04.752 ******** 2020-01-26T15:18:14.615 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-26T15:18:14.617 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:14.658 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.048) 0:01:04.800 ******** 2020-01-26T15:18:14.665 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:18:14.666 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [common : Include apt_system vars] **************************************** ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:14.707 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.049) 0:01:04.850 ******** 2020-01-26T15:18:14.743 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.035) 0:01:04.886 ******** 2020-01-26T15:18:14.753 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:14.792 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.048) 0:01:04.935 ******** 2020-01-26T15:18:14.798 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-01-26T15:18:14.800 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:14.849 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.057) 0:01:04.992 ******** 2020-01-26T15:18:14.854 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-01-26T15:18:14.856 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:18:14.856 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:14.901 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.051) 0:01:05.043 ******** 2020-01-26T15:18:14.942 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.041) 0:01:05.085 ******** 2020-01-26T15:18:14.946 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-01-26T15:18:14.948 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:14.991 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:14 +0000 (0:00:00.049) 0:01:05.134 ******** 2020-01-26T15:18:14.997 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-26T15:18:14.998 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:15.072 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.080) 0:01:05.215 ******** 2020-01-26T15:18:15.080 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-01-26T15:18:15.082 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:15.085 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:15.127 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.054) 0:01:05.269 ******** 2020-01-26T15:18:15.131 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-26T15:18:15.132 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:15.172 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.045) 0:01:05.314 ******** 2020-01-26T15:18:15.177 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-01-26T15:18:15.177 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:15.218 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.046) 0:01:05.361 ******** 2020-01-26T15:18:15.223 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-01-26T15:18:15.224 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:15.264 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.046) 0:01:05.407 ******** 2020-01-26T15:18:15.269 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-26T15:18:15.270 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:18:15.312 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.047) 0:01:05.455 ******** 2020-01-26T15:18:15.592 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:18:15.632 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.319) 0:01:05.774 ******** 2020-01-26T15:18:15.958 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-01-26T15:18:15.960 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:37 UTC", "ActiveEnterTimestampMonotonic": "17247442", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target basic.target local-fs.target var-run.mount -.mount remote-fs.target time-sync.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:37 UTC", "AssertTimestampMonotonic": "17246470", "Before": "plymouth-quit.service getty@tty1.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:37 UTC", "ConditionTimestampMonotonic": "17246470", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-01-26T15:18:15.962 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1373", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:37 UTC", "ExecMainStartTimestampMonotonic": "17247409", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:16:37 UTC] ; stop_time=[n/a] ; pid=1373 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:37 UTC", "InactiveExitTimestampMonotonic": "17247442", "InvocationID": "882370fb57af4644b737b400009005ab", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-01-26T15:18:15.963 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1373", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-01-26T15:18:15.965 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:37 UTC", "StateChangeTimestampMonotonic": "17247442", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:37 UTC", "WatchdogTimestampMonotonic": "17247441", "WatchdogUSec": "0"}} ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ActiveEnterTimestampMonotonic": "18298207", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target network.target sysinit.target system.slice systemd-journald.socket nss-lookup.target basic.target time-sync.target var-run.mount -.mount remote-fs.target 2020-01-26T15:18:15.966 INFO:teuthology.task.ansible.out: systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:45 UTC", "AssertTimestampMonotonic": "18297505", "Before": "shutdown.target multi-user.target plymouth-quit.service getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ConditionTimestampMonotonic": "18297505", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1276", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ExecMainStartTimestampMonotonic": 2020-01-26T15:18:15.968 INFO:teuthology.task.ansible.out: "18298178", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:16:45 UTC] ; stop_time=[n/a] ; pid=1276 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:45 UTC", "InactiveExitTimestampMonotonic": "18298207", "InvocationID": "e2395c3f0c3e408b9de5f6387bb6c699", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "40 2020-01-26T15:18:15.969 INFO:teuthology.task.ansible.out:96", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1276", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "St 2020-01-26T15:18:15.971 INFO:teuthology.task.ansible.out:artLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:45 UTC", "StateChangeTimestampMonotonic": "18298207", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:45 UTC", "WatchdogTimestampMonotonic": "18298206", "WatchdogUSec": "0"}} 2020-01-26T15:18:16.005 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:15 +0000 (0:00:00.373) 0:01:06.148 ******** 2020-01-26T15:18:16.039 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.033) 0:01:06.181 ******** 2020-01-26T15:18:16.043 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-01-26T15:18:16.044 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.082 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.043) 0:01:06.225 ******** 2020-01-26T15:18:16.087 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.127 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.044) 0:01:06.270 ******** 2020-01-26T15:18:16.131 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-01-26T15:18:16.133 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.171 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.043) 0:01:06.313 ******** 2020-01-26T15:18:16.175 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.215 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.044) 0:01:06.358 ******** 2020-01-26T15:18:16.219 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-01-26T15:18:16.221 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.258 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.043) 0:01:06.401 ******** 2020-01-26T15:18:16.263 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.304 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.045) 0:01:06.447 ******** 2020-01-26T15:18:16.310 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-26T15:18:16.310 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.312 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:16.350 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.046) 0:01:06.493 ******** 2020-01-26T15:18:16.386 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.035) 0:01:06.529 ******** 2020-01-26T15:18:16.390 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-26T15:18:16.392 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.432 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.045) 0:01:06.574 ******** 2020-01-26T15:18:16.468 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.036) 0:01:06.611 ******** 2020-01-26T15:18:16.472 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:18:16.474 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.516 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.047) 0:01:06.659 ******** 2020-01-26T15:18:16.521 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-26T15:18:16.523 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.562 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.046) 0:01:06.705 ******** 2020-01-26T15:18:16.567 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:18:16.569 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.617 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.054) 0:01:06.759 ******** 2020-01-26T15:18:16.623 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:18:16.625 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.665 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.048) 0:01:06.808 ******** 2020-01-26T15:18:16.670 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-01-26T15:18:16.672 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.714 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.048) 0:01:06.857 ******** 2020-01-26T15:18:16.719 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:18:16.721 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-01-26T15:18:16.763 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.048) 0:01:06.906 ******** 2020-01-26T15:18:16.800 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.037) 0:01:06.943 ******** 2020-01-26T15:18:16.805 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-26T15:18:16.805 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.807 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.849 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.048) 0:01:06.992 ******** 2020-01-26T15:18:16.886 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.036) 0:01:07.028 ******** 2020-01-26T15:18:16.892 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-01-26T15:18:16.892 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.934 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.048) 0:01:07.076 ******** 2020-01-26T15:18:16.938 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-26T15:18:16.939 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:16.982 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:16 +0000 (0:00:00.047) 0:01:07.124 ******** 2020-01-26T15:18:16.986 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-26T15:18:16.987 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:17.030 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.049) 0:01:07.173 ******** 2020-01-26T15:18:17.037 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-01-26T15:18:17.037 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.081 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.050) 0:01:07.224 ******** 2020-01-26T15:18:17.087 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:18:17.088 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:18:17.134 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.052) 0:01:07.276 ******** 2020-01-26T15:18:17.140 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-01-26T15:18:17.141 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-01-26T15:18:17.142 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:17.186 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.052) 0:01:07.329 ******** 2020-01-26T15:18:17.226 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.039) 0:01:07.368 ******** 2020-01-26T15:18:17.231 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-26T15:18:17.232 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:18:17.234 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:18:17.235 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:18:17.277 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.051) 0:01:07.420 ******** 2020-01-26T15:18:17.317 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.039) 0:01:07.460 ******** 2020-01-26T15:18:17.322 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:18:17.322 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:18:17.364 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.047) 0:01:07.507 ******** 2020-01-26T15:18:17.371 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi129.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:18:17.372 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-01-26T15:18:17.373 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:17.413 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.049) 0:01:07.556 ******** 2020-01-26T15:18:17.449 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.035) 0:01:07.592 ******** 2020-01-26T15:18:17.454 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:18:17.454 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:18:17.496 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.046) 0:01:07.639 ******** 2020-01-26T15:18:17.501 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-01-26T15:18:17.502 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:18:17.543 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.046) 0:01:07.686 ******** 2020-01-26T15:18:17.578 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.034) 0:01:07.720 ******** 2020-01-26T15:18:17.603 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-01-26T15:18:17.605 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-01-26T15:18:17.647 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.069) 0:01:07.790 ******** 2020-01-26T15:18:17.653 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:18:17.703 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.055) 0:01:07.846 ******** 2020-01-26T15:18:17.708 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-26T15:18:17.710 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:18:17.711 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.753 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.050) 0:01:07.896 ******** 2020-01-26T15:18:17.790 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.036) 0:01:07.932 ******** 2020-01-26T15:18:17.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-01-26T15:18:17.795 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.838 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.047) 0:01:07.980 ******** 2020-01-26T15:18:17.843 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:18:17.885 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.047) 0:01:08.027 ******** 2020-01-26T15:18:17.890 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-26T15:18:17.890 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.931 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.045) 0:01:08.073 ******** 2020-01-26T15:18:17.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-01-26T15:18:17.937 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:17.978 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:17 +0000 (0:00:00.047) 0:01:08.121 ******** 2020-01-26T15:18:18.005 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-26T15:18:18.007 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.046 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.067) 0:01:08.189 ******** 2020-01-26T15:18:18.083 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-26T15:18:18.084 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-26T15:18:18.126 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.079) 0:01:08.269 ******** 2020-01-26T15:18:18.132 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-01-26T15:18:18.132 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2020-01-26T15:18:18.175 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.048) 0:01:08.318 ******** 2020-01-26T15:18:18.201 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi129.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-26T15:18:18.244 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.069) 0:01:08.387 ******** 2020-01-26T15:18:18.398 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-01-26T15:18:18.400 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:17:00 UTC", "ActiveEnterTimestampMonotonic": "17913744", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target remote-fs.target network.target -.mount local-fs.target sysinit.target systemd-journald.socket basic.target var-run.mount system.slice systemd-tmpfiles-setup.service nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:17:00 UTC", "AssertTimestampMonotonic": "17913058", "Before": "getty@tty1.service multi-user.target shutdown.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:17:00 UTC", "ConditionTimestampMonotonic": "17913058", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-01-26T15:18:18.402 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1231", "ExecMainStartTimestamp": "Sun 2020-01-26 15:17:00 UTC", "ExecMainStartTimestampMonotonic": "17913715", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sun 2020-01-26 15:17:00 UTC] ; stop_time=[n/a] ; pid=1231 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:17:00 UTC", "InactiveExitTimestampMonotonic": "17913744", "InvocationID": "2ef8d35209734897beda77d041e41b81", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-01-26T15:18:18.403 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1231", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-01-26T15:18:18.405 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:17:00 UTC", "StateChangeTimestampMonotonic": "17913744", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:17:00 UTC", "WatchdogTimestampMonotonic": "17913743", "WatchdogUSec": "0"}} 2020-01-26T15:18:18.442 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.197) 0:01:08.585 ******** 2020-01-26T15:18:18.467 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-01-26T15:18:18.469 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.509 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.065) 0:01:08.650 ******** 2020-01-26T15:18:18.533 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-01-26T15:18:18.535 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.577 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.069) 0:01:08.719 ******** 2020-01-26T15:18:18.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:18:18.583 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:18:18.624 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.047) 0:01:08.767 ******** 2020-01-26T15:18:18.628 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-01-26T15:18:18.631 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.677 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.052) 0:01:08.820 ******** 2020-01-26T15:18:18.681 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:18:18.682 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:18:18.683 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi042"}, "changed": false} 2020-01-26T15:18:18.722 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.045) 0:01:08.865 ******** 2020-01-26T15:18:18.758 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.035) 0:01:08.901 ******** 2020-01-26T15:18:18.765 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-01-26T15:18:18.766 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.808 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.050) 0:01:08.951 ******** 2020-01-26T15:18:18.814 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-01-26T15:18:18.815 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi129"}, "changed": false} 2020-01-26T15:18:18.857 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.048) 0:01:08.999 ******** 2020-01-26T15:18:18.863 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-01-26T15:18:18.865 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.907 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.049) 0:01:09.049 ******** 2020-01-26T15:18:18.934 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-01-26T15:18:18.936 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:18.975 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:18 +0000 (0:00:00.068) 0:01:09.118 ******** 2020-01-26T15:18:19.002 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-01-26T15:18:19.004 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:19.043 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.068) 0:01:09.186 ******** 2020-01-26T15:18:19.081 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-01-26T15:18:19.083 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:19.119 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.075) 0:01:09.262 ******** 2020-01-26T15:18:19.156 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-01-26T15:18:19.158 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:19.204 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.085) 0:01:09.347 ******** 2020-01-26T15:18:19.231 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-01-26T15:18:19.232 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:19.271 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.067) 0:01:09.414 ******** 2020-01-26T15:18:19.298 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-01-26T15:18:19.299 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-01-26T15:18:19.337 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.066) 0:01:09.480 ******** 2020-01-26T15:18:19.375 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-01-26T15:18:19.375 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-01-26T15:18:19.415 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.077) 0:01:09.558 ******** 2020-01-26T15:18:19.452 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-01-26T15:18:19.454 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-01-26T15:18:19.493 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.078) 0:01:09.636 ******** 2020-01-26T15:18:19.531 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-01-26T15:18:19.533 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-01-26T15:18:19.572 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.078) 0:01:09.715 ******** 2020-01-26T15:18:19.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-01-26T15:18:19.589 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi129.front.sepia.ceph.com", "ansible_hostname": "smithi129", "ansible_nodename": "smithi129"}, "changed": true, "name": "smithi129"} 2020-01-26T15:18:19.630 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.058) 0:01:09.773 ******** 2020-01-26T15:18:19.637 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi042.front.sepia.ceph.com", "ansible_hostname": "smithi042", "ansible_nodename": "smithi042"}, "changed": true, "name": "smithi042"} 2020-01-26T15:18:19.677 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.046) 0:01:09.820 ******** 2020-01-26T15:18:19.704 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-01-26T15:18:19.706 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-01-26T15:18:19.745 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.068) 0:01:09.888 ******** 2020-01-26T15:18:19.876 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-01-26T15:18:19.878 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2020-01-26T15:18:19.917 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.172) 0:01:10.060 ******** 2020-01-26T15:18:19.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:18:19.944 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:18:19.946 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:19.986 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:19 +0000 (0:00:00.068) 0:01:10.129 ******** 2020-01-26T15:18:20.026 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.037) 0:01:10.166 ******** 2020-01-26T15:18:20.029 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:18:20.030 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:18:20.071 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.047) 0:01:10.214 ******** 2020-01-26T15:18:20.076 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-01-26T15:18:20.077 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:20.125 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.054) 0:01:10.268 ******** 2020-01-26T15:18:20.277 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-01-26T15:18:20.279 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-01-26T15:18:20.324 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.198) 0:01:10.466 ******** 2020-01-26T15:18:20.330 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-26T15:18:20.330 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:18:20.375 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.051) 0:01:10.518 ******** 2020-01-26T15:18:20.392 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:18:20.436 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.061) 0:01:10.579 ******** 2020-01-26T15:18:20.715 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-01-26T15:18:20.716 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-01-26T15:18:20.758 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.320) 0:01:10.899 ******** 2020-01-26T15:18:20.787 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:20.789 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi204"}, "changed": false} 2020-01-26T15:18:20.829 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.072) 0:01:10.972 ******** 2020-01-26T15:18:20.899 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-01-26T15:18:20.900 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:18:20.940 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.110) 0:01:11.083 ******** 2020-01-26T15:18:20.945 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:18:20.993 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:20 +0000 (0:00:00.053) 0:01:11.136 ******** 2020-01-26T15:18:20.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-26T15:18:21.008 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.047 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.054) 0:01:11.190 ******** 2020-01-26T15:18:21.053 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.094 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.047) 0:01:11.237 ******** 2020-01-26T15:18:21.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:18:21.100 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.141 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.046) 0:01:11.284 ******** 2020-01-26T15:18:21.147 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.190 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.048) 0:01:11.332 ******** 2020-01-26T15:18:21.195 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:18:21.196 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.236 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.046) 0:01:11.379 ******** 2020-01-26T15:18:21.243 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.285 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.048) 0:01:11.428 ******** 2020-01-26T15:18:21.292 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.341 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.056) 0:01:11.484 ******** 2020-01-26T15:18:21.348 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.348 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-01-26T15:18:21.348 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi204.front.sepia.ceph.com", "ansible_hostname": "smithi204", "ansible_nodename": "smithi204"}, "changed": true, "name": "smithi204"} 2020-01-26T15:18:21.390 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.048) 0:01:11.533 ******** 2020-01-26T15:18:21.427 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.036) 0:01:11.570 ******** 2020-01-26T15:18:21.432 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.433 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.478 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.051) 0:01:11.621 ******** 2020-01-26T15:18:21.516 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.037) 0:01:11.659 ******** 2020-01-26T15:18:21.521 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:18:21.521 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.562 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.046) 0:01:11.705 ******** 2020-01-26T15:18:21.569 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.611 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.048) 0:01:11.754 ******** 2020-01-26T15:18:21.616 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:18:21.617 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.658 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.047) 0:01:11.801 ******** 2020-01-26T15:18:21.664 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:21.705 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.047) 0:01:11.848 ******** 2020-01-26T15:18:21.711 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-26T15:18:21.755 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.049) 0:01:11.898 ******** 2020-01-26T15:18:21.761 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-01-26T15:18:21.762 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-01-26T15:18:21.802 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.046) 0:01:11.945 ******** 2020-01-26T15:18:21.839 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.037) 0:01:11.982 ******** 2020-01-26T15:18:21.844 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-26T15:18:21.887 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.047) 0:01:12.030 ******** 2020-01-26T15:18:21.922 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.034) 0:01:12.064 ******** 2020-01-26T15:18:21.927 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-26T15:18:21.968 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:21 +0000 (0:00:00.045) 0:01:12.110 ******** 2020-01-26T15:18:22.014 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.045) 0:01:12.156 ******** 2020-01-26T15:18:22.019 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-01-26T15:18:22.020 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.060 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.046) 0:01:12.203 ******** 2020-01-26T15:18:22.066 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.114 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.054) 0:01:12.257 ******** 2020-01-26T15:18:22.130 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.167 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.052) 0:01:12.310 ******** 2020-01-26T15:18:22.172 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.173 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.176 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-01-26T15:18:22.176 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-01-26T15:18:22.216 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.049) 0:01:12.359 ******** 2020-01-26T15:18:22.258 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.041) 0:01:12.401 ******** 2020-01-26T15:18:22.262 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-01-26T15:18:22.263 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.265 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.307 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.048) 0:01:12.450 ******** 2020-01-26T15:18:22.345 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.038) 0:01:12.488 ******** 2020-01-26T15:18:22.350 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:18:22.351 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.394 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.048) 0:01:12.537 ******** 2020-01-26T15:18:22.403 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.050) 0:01:12.587 ******** 2020-01-26T15:18:22.449 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-26T15:18:22.450 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.492 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.047) 0:01:12.635 ******** 2020-01-26T15:18:22.498 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.541 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.048) 0:01:12.684 ******** 2020-01-26T15:18:22.547 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-01-26T15:18:22.549 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.590 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.049) 0:01:12.733 ******** 2020-01-26T15:18:22.596 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.648 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.057) 0:01:12.791 ******** 2020-01-26T15:18:22.653 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-26T15:18:22.655 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.694 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.045) 0:01:12.837 ******** 2020-01-26T15:18:22.700 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.740 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.045) 0:01:12.883 ******** 2020-01-26T15:18:22.745 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-01-26T15:18:22.747 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.796 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.055) 0:01:12.938 ******** 2020-01-26T15:18:22.801 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.802 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-01-26T15:18:22.804 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-01-26T15:18:22.842 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.046) 0:01:12.985 ******** 2020-01-26T15:18:22.876 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.034) 0:01:13.019 ******** 2020-01-26T15:18:22.881 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:18:22.881 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.883 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:22.923 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.046) 0:01:13.066 ******** 2020-01-26T15:18:22.958 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.035) 0:01:13.101 ******** 2020-01-26T15:18:22.964 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-01-26T15:18:22.965 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.004 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:22 +0000 (0:00:00.045) 0:01:13.147 ******** 2020-01-26T15:18:23.040 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.035) 0:01:13.182 ******** 2020-01-26T15:18:23.045 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.046 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.086 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.045) 0:01:13.228 ******** 2020-01-26T15:18:23.122 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.036) 0:01:13.265 ******** 2020-01-26T15:18:23.126 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:18:23.128 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.169 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.046) 0:01:13.312 ******** 2020-01-26T15:18:23.206 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.036) 0:01:13.349 ******** 2020-01-26T15:18:23.214 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-01-26T15:18:23.216 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.255 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.049) 0:01:13.398 ******** 2020-01-26T15:18:23.293 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.037) 0:01:13.436 ******** 2020-01-26T15:18:23.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:18:23.300 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.340 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.046) 0:01:13.482 ******** 2020-01-26T15:18:23.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.038) 0:01:13.521 ******** 2020-01-26T15:18:23.383 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:23.383 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.384 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.425 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.046) 0:01:13.567 ******** 2020-01-26T15:18:23.459 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.034) 0:01:13.602 ******** 2020-01-26T15:18:23.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:18:23.465 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.466 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-01-26T15:18:23.466 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.507 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.047) 0:01:13.650 ******** 2020-01-26T15:18:23.544 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.036) 0:01:13.687 ******** 2020-01-26T15:18:23.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-26T15:18:23.550 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.592 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.047) 0:01:13.734 ******** 2020-01-26T15:18:23.627 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.035) 0:01:13.770 ******** 2020-01-26T15:18:23.632 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:18:23.633 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.691 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.064) 0:01:13.834 ******** 2020-01-26T15:18:23.736 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.044) 0:01:13.879 ******** 2020-01-26T15:18:23.743 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:18:23.744 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.809 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.072) 0:01:13.951 ******** 2020-01-26T15:18:23.813 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:18:23.815 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.856 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.047) 0:01:13.998 ******** 2020-01-26T15:18:23.860 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-01-26T15:18:23.861 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005220", "end": "2020-01-26 15:18:23.811138", "rc": 0, "start": "2020-01-26 15:18:23.805918", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:23.863 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:23.902 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.046) 0:01:14.045 ******** 2020-01-26T15:18:23.937 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.035) 0:01:14.080 ******** 2020-01-26T15:18:23.942 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:18:23.943 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:18:23.987 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:23 +0000 (0:00:00.049) 0:01:14.130 ******** 2020-01-26T15:18:24.023 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.035) 0:01:14.166 ******** 2020-01-26T15:18:24.028 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-01-26T15:18:24.030 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.070 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.047) 0:01:14.213 ******** 2020-01-26T15:18:24.075 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-01-26T15:18:24.116 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.046) 0:01:14.259 ******** 2020-01-26T15:18:24.122 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-26T15:18:24.123 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.162 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.045) 0:01:14.305 ******** 2020-01-26T15:18:24.167 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-01-26T15:18:24.210 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.047) 0:01:14.353 ******** 2020-01-26T15:18:24.215 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-01-26T15:18:24.216 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.258 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.047) 0:01:14.400 ******** 2020-01-26T15:18:24.263 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-01-26T15:18:24.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.050) 0:01:14.451 ******** 2020-01-26T15:18:24.313 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-26T15:18:24.314 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:18:24.357 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.048) 0:01:14.500 ******** 2020-01-26T15:18:24.363 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-01-26T15:18:24.365 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.411 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.054) 0:01:14.554 ******** 2020-01-26T15:18:24.416 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-26T15:18:24.417 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005160", "end": "2020-01-26 15:18:24.385068", "rc": 0, "start": "2020-01-26 15:18:24.379908", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:24.462 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.050) 0:01:14.604 ******** 2020-01-26T15:18:24.500 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.037) 0:01:14.642 ******** 2020-01-26T15:18:24.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-01-26T15:18:24.507 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.509 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.550 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.050) 0:01:14.693 ******** 2020-01-26T15:18:24.556 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:18:24.601 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.050) 0:01:14.744 ******** 2020-01-26T15:18:24.607 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-01-26T15:18:24.609 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.650 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.048) 0:01:14.792 ******** 2020-01-26T15:18:24.675 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:18:24.677 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.717 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.067) 0:01:14.860 ******** 2020-01-26T15:18:24.744 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-01-26T15:18:24.746 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.784 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.066) 0:01:14.927 ******** 2020-01-26T15:18:24.810 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-01-26T15:18:24.812 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.850 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.065) 0:01:14.992 ******** 2020-01-26T15:18:24.876 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-01-26T15:18:24.878 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:24.918 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.068) 0:01:15.061 ******** 2020-01-26T15:18:24.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-26T15:18:24.923 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:18:24.964 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:24 +0000 (0:00:00.045) 0:01:15.106 ******** 2020-01-26T15:18:24.969 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-01-26T15:18:24.970 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.016 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.051) 0:01:15.158 ******** 2020-01-26T15:18:25.021 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-26T15:18:25.023 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.061 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.045) 0:01:15.204 ******** 2020-01-26T15:18:25.066 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:18:25.067 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.112 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.051) 0:01:15.255 ******** 2020-01-26T15:18:25.138 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:18:25.140 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.178 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.321 ******** 2020-01-26T15:18:25.204 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-01-26T15:18:25.206 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.245 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.388 ******** 2020-01-26T15:18:25.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:25.273 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.311 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.065) 0:01:15.454 ******** 2020-01-26T15:18:25.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-01-26T15:18:25.339 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.520 ******** 2020-01-26T15:18:25.403 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:18:25.405 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.067) 0:01:15.588 ******** 2020-01-26T15:18:25.471 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:25.473 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.511 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.654 ******** 2020-01-26T15:18:25.538 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-01-26T15:18:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.577 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.720 ******** 2020-01-26T15:18:25.603 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-01-26T15:18:25.605 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.645 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.067) 0:01:15.788 ******** 2020-01-26T15:18:25.671 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-01-26T15:18:25.673 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:25.712 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.066) 0:01:15.854 ******** 2020-01-26T15:18:25.844 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-01-26T15:18:25.845 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005195", "end": "2020-01-26 15:18:25.811603", "rc": 0, "start": "2020-01-26 15:18:25.806408", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:25.887 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.175) 0:01:16.030 ******** 2020-01-26T15:18:25.891 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-26T15:18:25.892 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:18:25.914 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-01-26T15:18:25.957 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:25 +0000 (0:00:00.069) 0:01:16.099 ******** 2020-01-26T15:18:26.059 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi129.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:18:26.267 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-01-26T15:18:26.269 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-01-26T15:18:26.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:26 +0000 (0:00:00.351) 0:01:16.450 ******** 2020-01-26T15:18:26.334 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-01-26T15:18:26.335 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:26.372 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:26 +0000 (0:00:00.064) 0:01:16.515 ******** 2020-01-26T15:18:26.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-26T15:18:26.817 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:18:26.858 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:26 +0000 (0:00:00.486) 0:01:17.001 ******** 2020-01-26T15:18:26.980 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:18:27.025 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:27 +0000 (0:00:00.166) 0:01:17.167 ******** 2020-01-26T15:18:27.366 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-01-26T15:18:27.755 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-26T15:18:27.757 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:27.796 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:27 +0000 (0:00:00.771) 0:01:17.939 ******** 2020-01-26T15:18:27.824 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:18:27.863 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:27 +0000 (0:00:00.067) 0:01:18.006 ******** 2020-01-26T15:18:27.900 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-26T15:18:27.901 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:27.942 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:27 +0000 (0:00:00.078) 0:01:18.085 ******** 2020-01-26T15:18:27.969 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:18:28.010 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:28 +0000 (0:00:00.067) 0:01:18.153 ******** 2020-01-26T15:18:28.026 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-26T15:18:28.027 INFO:teuthology.task.ansible.out: [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034325", "end": "2020-01-26 15:18:28.009090", "rc": 0, "start": "2020-01-26 15:18:27.974765", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:28.082 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:28 +0000 (0:00:00.071) 0:01:18.225 ******** 2020-01-26T15:18:28.178 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034632", "end": "2020-01-26 15:18:28.171797", "rc": 0, "start": "2020-01-26 15:18:28.137165", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:28.225 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:28 +0000 (0:00:00.142) 0:01:18.368 ******** 2020-01-26T15:18:28.286 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-01-26T15:18:28.287 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-01-26T15:18:28.332 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:28 +0000 (0:00:00.107) 0:01:18.475 ******** 2020-01-26T15:18:29.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-01-26T15:18:29.212 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:29.252 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:29 +0000 (0:00:00.919) 0:01:19.395 ******** 2020-01-26T15:18:29.276 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-01-26T15:18:29.318 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:29 +0000 (0:00:00.065) 0:01:19.460 ******** 2020-01-26T15:18:29.481 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-01-26T15:18:29.482 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032851", "end": "2020-01-26 15:18:29.452149", "rc": 0, "start": "2020-01-26 15:18:29.419298", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:18:29.520 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:29 +0000 (0:00:00.202) 0:01:19.663 ******** 2020-01-26T15:18:31.016 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-01-26T15:18:31.017 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:31.062 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:31 +0000 (0:00:01.541) 0:01:21.205 ******** 2020-01-26T15:18:31.073 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:31.133 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:31 +0000 (0:00:00.070) 0:01:21.275 ******** 2020-01-26T15:18:32.376 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:32.420 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:32 +0000 (0:00:01.287) 0:01:22.563 ******** 2020-01-26T15:18:41.797 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-01-26T15:18:41.798 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-26T15:18:41.800 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-26T15:18:41.802 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:41.839 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:41 +0000 (0:00:09.418) 0:01:31.982 ******** 2020-01-26T15:18:41.942 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-26T15:18:41.945 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-26T15:18:41.946 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:41.992 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:41 +0000 (0:00:00.153) 0:01:32.135 ******** 2020-01-26T15:18:42.694 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:42.697 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:42.738 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:42 +0000 (0:00:00.745) 0:01:32.881 ******** 2020-01-26T15:18:42.765 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-26T15:18:42.767 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:42.805 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:42 +0000 (0:00:00.067) 0:01:32.948 ******** 2020-01-26T15:18:42.864 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:42.865 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:42.907 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:42 +0000 (0:00:00.101) 0:01:33.050 ******** 2020-01-26T15:18:42.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-26T15:18:42.935 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:42.975 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:42 +0000 (0:00:00.067) 0:01:33.117 ******** 2020-01-26T15:18:43.224 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-01-26T15:18:43.225 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137378 files and directorie 2020-01-26T15:18:43.227 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 53 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-01-26T15:18:43.230 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137378 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:43.265 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:43 +0000 (0:00:00.290) 0:01:33.408 ******** 2020-01-26T15:18:44.142 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:44.144 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:44.184 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:44 +0000 (0:00:00.918) 0:01:34.327 ******** 2020-01-26T15:18:44.210 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-01-26T15:18:44.212 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:44.253 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:44 +0000 (0:00:00.069) 0:01:34.396 ******** 2020-01-26T15:18:52.937 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:52.939 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9730 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:18:52.940 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:18:52.942 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9730 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:18:52.943 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:18:52.945 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:52.977 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:52 +0000 (0:00:08.723) 0:01:43.120 ******** 2020-01-26T15:18:53.526 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9851 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:18:53.528 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:18:53.529 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9851 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:18:53.531 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking l 2020-01-26T15:18:53.531 INFO:teuthology.task.ansible.out:ibrbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:18:53.532 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:53.571 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:53 +0000 (0:00:00.594) 0:01:43.714 ******** 2020-01-26T15:18:53.858 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-01-26T15:18:53.859 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:18:53.899 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:53 +0000 (0:00:00.328) 0:01:44.042 ******** 2020-01-26T15:18:54.042 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:18:54.044 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:18:54.079 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.180) 0:01:44.222 ******** 2020-01-26T15:18:54.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-26T15:18:54.108 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:54.149 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.069) 0:01:44.291 ******** 2020-01-26T15:18:54.218 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:54.221 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n python-nose-doc samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 python3-nose qemu-block-extra qemu-system-common\n qemu-system-x86 qemu-utils\n0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.\nNeed to get 10.5 MB of archives.\nAfter this operation, 48.1 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.5 MB in 1s (9728 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Re 2020-01-26T15:18:54.223 INFO:teuthology.task.ansible.out:ading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137236 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package python3-nose.\r\nPreparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...\r\nUnpacking python3-nose (1.3.7-3) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up python3-nose (1.3.7-3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block- 2020-01-26T15:18:54.224 INFO:teuthology.task.ansible.out:extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " python-nose-doc samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 python3-nose qemu-block-extra qemu-system-common", " qemu-system-x86 qemu-utils", "0 upgraded, 7 newly installed, 0 to remove and 53 not upgraded.", "Need to get 10.5 MB of archives.", "After this operation, 48.1 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.4 [2704 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.4 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.5 MB in 1s (9728 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading databa 2020-01-26T15:18:54.226 INFO:teuthology.task.ansible.out:se ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137236 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package python3-nose.", "Preparing to unpack .../4-python3-nose_1.3.7-3_all.deb ...", "Unpacking python3-nose (1.3.7-3) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.4) ...", "Setting 2020-01-26T15:18:54.227 INFO:teuthology.task.ansible.out:up python3-nose (1.3.7-3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2020-01-26T15:18:54.265 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.116) 0:01:44.408 ******** 2020-01-26T15:18:54.281 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-26T15:18:54.283 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:18:54.325 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.059) 0:01:44.468 ******** 2020-01-26T15:18:54.461 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-01-26T15:18:54.462 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:18:54.506 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.180) 0:01:44.649 ******** 2020-01-26T15:18:54.642 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:18:54.642 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:18:54.644 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-26T15:18:54.689 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.183) 0:01:44.832 ******** 2020-01-26T15:18:54.726 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.036) 0:01:44.869 ******** 2020-01-26T15:18:54.731 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-26T15:18:54.731 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:54.781 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.054) 0:01:44.924 ******** 2020-01-26T15:18:54.872 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-01-26T15:18:54.873 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:18:54.916 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.135) 0:01:45.059 ******** 2020-01-26T15:18:54.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-26T15:18:54.923 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:18:54.969 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:54 +0000 (0:00:00.052) 0:01:45.111 ******** 2020-01-26T15:18:55.038 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-01-26T15:18:55.039 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:55.083 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.114) 0:01:45.226 ******** 2020-01-26T15:18:55.131 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-01-26T15:18:55.132 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:18:55.174 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.091) 0:01:45.317 ******** 2020-01-26T15:18:55.297 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-01-26T15:18:55.299 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-01-26T15:18:55.300 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-01-26T15:18:55.341 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.166) 0:01:45.484 ******** 2020-01-26T15:18:55.382 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.041) 0:01:45.525 ******** 2020-01-26T15:18:55.387 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-26T15:18:55.390 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:38 UTC", "ActiveEnterTimestampMonotonic": "17858658", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service network.target basic.target systemd-journald.socket system.slice remote-fs.target -.mount nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:37 UTC", "AssertTimestampMonotonic": "17243689", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:37 UTC", "ConditionTimestampMonotonic": "17243689", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:18:55.392 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1492", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:38 UTC", "ExecMainStartTimestampMonotonic": "17858647", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:37 UTC", "InactiveExitTimestampMonotonic": "17244346", "InvocationID": "720817b9682f4ab5b2c8e52d8da2e1fe", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:18:55.394 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1492", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:18:55.396 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:38 UTC", "StateChangeTimestampMonotonic": "17858658", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:38 UTC", "WatchdogTimestampMonotonic": "17858657", "WatchdogUSec": "0"}} 2020-01-26T15:18:55.435 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.053) 0:01:45.578 ******** 2020-01-26T15:18:55.442 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-01-26T15:18:55.443 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.485 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.049) 0:01:45.628 ******** 2020-01-26T15:18:55.490 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:18:55.492 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.536 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.051) 0:01:45.679 ******** 2020-01-26T15:18:55.543 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-01-26T15:18:55.544 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:18:55.586 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.049) 0:01:45.728 ******** 2020-01-26T15:18:55.591 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:18:55.593 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.635 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.049) 0:01:45.778 ******** 2020-01-26T15:18:55.640 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-01-26T15:18:55.641 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-01-26T15:18:55.684 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.048) 0:01:45.827 ******** 2020-01-26T15:18:55.690 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:18:55.692 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.733 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.049) 0:01:45.876 ******** 2020-01-26T15:18:55.738 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-01-26T15:18:55.739 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:55.787 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.053) 0:01:45.930 ******** 2020-01-26T15:18:55.793 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:18:55.793 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.836 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.049) 0:01:45.979 ******** 2020-01-26T15:18:55.863 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:18:55.865 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.905 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.069) 0:01:46.048 ******** 2020-01-26T15:18:55.942 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:18:55.943 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:55.982 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:55 +0000 (0:00:00.077) 0:01:46.125 ******** 2020-01-26T15:18:56.010 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:18:56.012 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-01-26T15:18:56.051 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.068) 0:01:46.194 ******** 2020-01-26T15:18:56.089 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.038) 0:01:46.232 ******** 2020-01-26T15:18:56.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:18:56.094 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.096 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-26T15:18:56.098 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ActiveEnterTimestampMonotonic": "18933546", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service basic.target -.mount sysinit.target nss-lookup.target remote-fs.target systemd-journald.socket network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:45 UTC", "AssertTimestampMonotonic": "18298356", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ConditionTimestampMonotonic": "18298356", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:18:56.100 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1438", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ExecMainStartTimestampMonotonic": "18933512", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:45 UTC", "InactiveExitTimestampMonotonic": "18299083", "InvocationID": "faa0999549f44603be0d0366960ce5f1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:18:56.101 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1438", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:18:56.103 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:45 UTC", "StateChangeTimestampMonotonic": "18933546", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:45 UTC", "WatchdogTimestampMonotonic": "18933544", "WatchdogUSec": "0"}} 2020-01-26T15:18:56.141 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.051) 0:01:46.283 ******** 2020-01-26T15:18:56.178 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.037) 0:01:46.321 ******** 2020-01-26T15:18:56.183 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-01-26T15:18:56.184 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.224 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.045) 0:01:46.366 ******** 2020-01-26T15:18:56.228 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:18:56.230 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.270 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.046) 0:01:46.413 ******** 2020-01-26T15:18:56.276 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-01-26T15:18:56.276 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-01-26T15:18:56.278 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.316 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.045) 0:01:46.458 ******** 2020-01-26T15:18:56.353 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.035) 0:01:46.494 ******** 2020-01-26T15:18:56.356 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:56.356 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.358 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.405 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.053) 0:01:46.547 ******** 2020-01-26T15:18:56.441 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.036) 0:01:46.583 ******** 2020-01-26T15:18:56.446 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:18:56.447 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.488 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.047) 0:01:46.631 ******** 2020-01-26T15:18:56.494 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:56.495 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:18:56.536 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.047) 0:01:46.679 ******** 2020-01-26T15:18:56.572 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.034) 0:01:46.714 ******** 2020-01-26T15:18:56.575 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.577 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.618 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.047) 0:01:46.761 ******** 2020-01-26T15:18:56.653 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.034) 0:01:46.796 ******** 2020-01-26T15:18:56.658 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:18:56.659 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.700 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.046) 0:01:46.843 ******** 2020-01-26T15:18:56.706 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:56.709 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.750 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.049) 0:01:46.892 ******** 2020-01-26T15:18:56.758 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.798 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.048) 0:01:46.941 ******** 2020-01-26T15:18:56.803 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:18:56.805 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.942 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.144) 0:01:47.085 ******** 2020-01-26T15:18:56.949 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:18:56.951 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:56.952 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-01-26T15:18:56.954 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:17:01 UTC", "ActiveEnterTimestampMonotonic": "18569302", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target system.slice basic.target systemd-journald.socket nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:17:00 UTC", "AssertTimestampMonotonic": "17911718", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:17:00 UTC", "ConditionTimestampMonotonic": "17911718", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-01-26T15:18:56.955 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1384", "ExecMainStartTimestamp": "Sun 2020-01-26 15:17:01 UTC", "ExecMainStartTimestampMonotonic": "18569290", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:17:00 UTC", "InactiveExitTimestampMonotonic": "17912434", "InvocationID": "b38872eb737648d0a478d6d8da159194", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-01-26T15:18:56.957 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1384", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2020-01-26T15:18:56.958 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:17:01 UTC", "StateChangeTimestampMonotonic": "18569302", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:17:01 UTC", "WatchdogTimestampMonotonic": "18569301", "WatchdogUSec": "0"}} 2020-01-26T15:18:56.996 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:56 +0000 (0:00:00.053) 0:01:47.138 ******** 2020-01-26T15:18:57.033 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.037) 0:01:47.176 ******** 2020-01-26T15:18:57.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:18:57.040 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.080 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.045) 0:01:47.222 ******** 2020-01-26T15:18:57.115 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.036) 0:01:47.258 ******** 2020-01-26T15:18:57.121 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.122 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.165 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.047) 0:01:47.306 ******** 2020-01-26T15:18:57.201 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.037) 0:01:47.343 ******** 2020-01-26T15:18:57.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:18:57.205 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.248 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.047) 0:01:47.391 ******** 2020-01-26T15:18:57.287 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.038) 0:01:47.430 ******** 2020-01-26T15:18:57.293 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-01-26T15:18:57.294 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.334 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.046) 0:01:47.476 ******** 2020-01-26T15:18:57.370 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.035) 0:01:47.512 ******** 2020-01-26T15:18:57.375 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:18:57.376 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.376 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:57.376 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.415 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.045) 0:01:47.558 ******** 2020-01-26T15:18:57.453 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.037) 0:01:47.596 ******** 2020-01-26T15:18:57.458 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-01-26T15:18:57.460 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.502 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.048) 0:01:47.644 ******** 2020-01-26T15:18:57.537 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.035) 0:01:47.680 ******** 2020-01-26T15:18:57.542 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:18:57.543 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.545 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.584 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.046) 0:01:47.727 ******** 2020-01-26T15:18:57.624 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.040) 0:01:47.767 ******** 2020-01-26T15:18:57.630 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-01-26T15:18:57.631 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.631 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.672 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.047) 0:01:47.814 ******** 2020-01-26T15:18:57.707 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.034) 0:01:47.849 ******** 2020-01-26T15:18:57.711 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:57.712 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.712 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:18:57.713 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.755 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.047) 0:01:47.897 ******** 2020-01-26T15:18:57.793 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.037) 0:01:47.935 ******** 2020-01-26T15:18:57.798 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-01-26T15:18:57.799 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.800 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.840 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.047) 0:01:47.983 ******** 2020-01-26T15:18:57.876 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.036) 0:01:48.019 ******** 2020-01-26T15:18:57.881 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:18:57.883 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.922 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.046) 0:01:48.065 ******** 2020-01-26T15:18:57.958 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:57 +0000 (0:00:00.035) 0:01:48.101 ******** 2020-01-26T15:18:57.963 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-01-26T15:18:57.964 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:57.965 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.006 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.048) 0:01:48.149 ******** 2020-01-26T15:18:58.042 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.035) 0:01:48.184 ******** 2020-01-26T15:18:58.047 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:18:58.048 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.049 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.088 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.046) 0:01:48.231 ******** 2020-01-26T15:18:58.125 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.036) 0:01:48.267 ******** 2020-01-26T15:18:58.131 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-01-26T15:18:58.133 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.172 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.047) 0:01:48.315 ******** 2020-01-26T15:18:58.208 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.035) 0:01:48.350 ******** 2020-01-26T15:18:58.213 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.214 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.255 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.047) 0:01:48.398 ******** 2020-01-26T15:18:58.291 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.035) 0:01:48.433 ******** 2020-01-26T15:18:58.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-01-26T15:18:58.298 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.337 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.046) 0:01:48.480 ******** 2020-01-26T15:18:58.379 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.041) 0:01:48.521 ******** 2020-01-26T15:18:58.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:18:58.386 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.425 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.046) 0:01:48.568 ******** 2020-01-26T15:18:58.462 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.036) 0:01:48.605 ******** 2020-01-26T15:18:58.468 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-01-26T15:18:58.470 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.512 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.049) 0:01:48.654 ******** 2020-01-26T15:18:58.517 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:18:58.518 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.558 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.045) 0:01:48.700 ******** 2020-01-26T15:18:58.562 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-01-26T15:18:58.563 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.564 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:18:58.605 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.047) 0:01:48.748 ******** 2020-01-26T15:18:58.643 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.037) 0:01:48.785 ******** 2020-01-26T15:18:58.647 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-01-26T15:18:58.649 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.689 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.046) 0:01:48.832 ******** 2020-01-26T15:18:58.694 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-01-26T15:18:58.695 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.736 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.046) 0:01:48.879 ******** 2020-01-26T15:18:58.761 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.802 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.066) 0:01:48.945 ******** 2020-01-26T15:18:58.807 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-01-26T15:18:58.808 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:18:58.847 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.044) 0:01:48.990 ******** 2020-01-26T15:18:58.851 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:58.852 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.893 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.045) 0:01:49.035 ******** 2020-01-26T15:18:58.920 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:58.921 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:18:58.960 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.067) 0:01:49.103 ******** 2020-01-26T15:18:58.997 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:58 +0000 (0:00:00.036) 0:01:49.140 ******** 2020-01-26T15:18:59.001 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:18:59.002 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.042 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.045) 0:01:49.185 ******** 2020-01-26T15:18:59.047 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:18:59.049 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.088 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.045) 0:01:49.231 ******** 2020-01-26T15:18:59.114 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:18:59.116 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.154 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.065) 0:01:49.297 ******** 2020-01-26T15:18:59.169 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:18:59.170 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:18:59.210 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.055) 0:01:49.353 ******** 2020-01-26T15:18:59.216 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:18:59.217 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.259 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.049) 0:01:49.402 ******** 2020-01-26T15:18:59.264 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:18:59.266 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.308 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.049) 0:01:49.451 ******** 2020-01-26T15:18:59.314 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-01-26T15:18:59.316 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.360 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.051) 0:01:49.502 ******** 2020-01-26T15:18:59.364 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-01-26T15:18:59.366 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:18:59.409 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.049) 0:01:49.552 ******** 2020-01-26T15:18:59.415 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:59.415 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.463 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.053) 0:01:49.605 ******** 2020-01-26T15:18:59.464 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:59.491 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:59.493 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.538 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.075) 0:01:49.681 ******** 2020-01-26T15:18:59.540 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:59.566 INFO:teuthology.task.ansible.out: 2020-01-26T15:18:59.567 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.620 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.081) 0:01:49.763 ******** 2020-01-26T15:18:59.636 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-01-26T15:18:59.637 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:18:59.680 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.060) 0:01:49.823 ******** 2020-01-26T15:18:59.686 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-01-26T15:18:59.688 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.065) 0:01:49.889 ******** 2020-01-26T15:18:59.754 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:18:59.799 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.052) 0:01:49.942 ******** 2020-01-26T15:18:59.805 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-01-26T15:18:59.806 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.846 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.047) 0:01:49.989 ******** 2020-01-26T15:18:59.872 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-01-26T15:18:59.873 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.917 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.070) 0:01:50.060 ******** 2020-01-26T15:18:59.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-01-26T15:18:59.956 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:18:59.993 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:18:59 +0000 (0:00:00.075) 0:01:50.136 ******** 2020-01-26T15:19:00.030 INFO:teuthology.task.ansible.out: 2020-01-26T15:19:00.031 INFO:teuthology.task.ansible.out:TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-26T15:19:00.032 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:19:00.071 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.077) 0:01:50.214 ******** 2020-01-26T15:19:00.108 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-01-26T15:19:00.109 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-26T15:19:00.150 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.079) 0:01:50.293 ******** 2020-01-26T15:19:00.157 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-01-26T15:19:00.158 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-01-26T15:19:00.207 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.056) 0:01:50.349 ******** 2020-01-26T15:19:00.298 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-26T15:19:00.299 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:19:00.339 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.132) 0:01:50.482 ******** 2020-01-26T15:19:00.366 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-26T15:19:00.368 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.410 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.071) 0:01:50.553 ******** 2020-01-26T15:19:00.416 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-01-26T15:19:00.417 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-01-26T15:19:00.467 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.057) 0:01:50.610 ******** 2020-01-26T15:19:00.473 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-01-26T15:19:00.475 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.515 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.047) 0:01:50.658 ******** 2020-01-26T15:19:00.521 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-01-26T15:19:00.521 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-01-26T15:19:00.564 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.049) 0:01:50.707 ******** 2020-01-26T15:19:00.569 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-26T15:19:00.571 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.611 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.046) 0:01:50.754 ******** 2020-01-26T15:19:00.617 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-01-26T15:19:00.619 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:19:00.659 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.047) 0:01:50.802 ******** 2020-01-26T15:19:00.698 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.038) 0:01:50.841 ******** 2020-01-26T15:19:00.703 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-26T15:19:00.704 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.706 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.746 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.047) 0:01:50.889 ******** 2020-01-26T15:19:00.783 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.036) 0:01:50.926 ******** 2020-01-26T15:19:00.787 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-01-26T15:19:00.789 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.836 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.053) 0:01:50.979 ******** 2020-01-26T15:19:00.842 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-01-26T15:19:00.844 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.888 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.051) 0:01:51.031 ******** 2020-01-26T15:19:00.893 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:00.893 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:19:00.941 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.053) 0:01:51.084 ******** 2020-01-26T15:19:00.946 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-26T15:19:00.948 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.991 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:00 +0000 (0:00:00.050) 0:01:51.134 ******** 2020-01-26T15:19:00.996 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:00.997 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:00.999 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.010 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-26T15:19:01.011 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.012 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi042.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.057 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.066) 0:01:51.200 ******** 2020-01-26T15:19:01.063 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.064 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.065 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-01-26T15:19:01.066 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-01-26T15:19:01.067 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:01.075 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.076 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.078 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi042.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.128 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.071) 0:01:51.271 ******** 2020-01-26T15:19:01.133 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.134 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.135 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:01.137 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.137 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.138 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.188 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.059) 0:01:51.331 ******** 2020-01-26T15:19:01.225 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.036) 0:01:51.368 ******** 2020-01-26T15:19:01.252 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:01.254 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:19:01.295 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.069) 0:01:51.438 ******** 2020-01-26T15:19:01.344 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:19:01.345 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002968", "end": "2020-01-26 15:19:01.308738", "rc": 0, "start": "2020-01-26 15:19:01.305770", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:19:01.347 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi129.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.401 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.106) 0:01:51.544 ******** 2020-01-26T15:19:01.409 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.410 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.411 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.411 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.423 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.445 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-26T15:19:01.447 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi129.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-01-26T15:19:01.448 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-01-26T15:19:01.513 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.111) 0:01:51.656 ******** 2020-01-26T15:19:01.553 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.040) 0:01:51.696 ******** 2020-01-26T15:19:01.559 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:01.561 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi129.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.561 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.562 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.563 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.565 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-26T15:19:01.567 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.608 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.053) 0:01:51.750 ******** 2020-01-26T15:19:01.649 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.041) 0:01:51.792 ******** 2020-01-26T15:19:01.655 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-26T15:19:01.656 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.700 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.050) 0:01:51.843 ******** 2020-01-26T15:19:01.791 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:19:01.792 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003619", "end": "2020-01-26 15:19:01.774920", "rc": 0, "start": "2020-01-26 15:19:01.771301", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:19:01.837 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.137) 0:01:51.980 ******** 2020-01-26T15:19:01.864 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-01-26T15:19:01.866 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:01.914 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.077) 0:01:52.057 ******** 2020-01-26T15:19:01.953 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.038) 0:01:52.096 ******** 2020-01-26T15:19:01.957 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-26T15:19:01.959 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.003 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:01 +0000 (0:00:00.050) 0:01:52.146 ******** 2020-01-26T15:19:02.029 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-01-26T15:19:02.030 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.069 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.066) 0:01:52.212 ******** 2020-01-26T15:19:02.089 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-01-26T15:19:02.089 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:19:02.135 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.066) 0:01:52.278 ******** 2020-01-26T15:19:02.162 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-01-26T15:19:02.164 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.203 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.067) 0:01:52.345 ******** 2020-01-26T15:19:02.228 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-01-26T15:19:02.230 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.276 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.072) 0:01:52.418 ******** 2020-01-26T15:19:02.302 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-01-26T15:19:02.303 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.342 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.066) 0:01:52.485 ******** 2020-01-26T15:19:02.378 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-01-26T15:19:02.380 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.425 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.082) 0:01:52.567 ******** 2020-01-26T15:19:02.451 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-01-26T15:19:02.453 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.495 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.066) 0:01:52.633 ******** 2020-01-26T15:19:02.516 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:02.518 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-01-26T15:19:02.558 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.067) 0:01:52.701 ******** 2020-01-26T15:19:02.604 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:02.606 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.607 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:19:02.651 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.093) 0:01:52.794 ******** 2020-01-26T15:19:02.658 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-01-26T15:19:02.659 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.660 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.661 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.662 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.672 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.673 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.675 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi204.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.723 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.071) 0:01:52.866 ******** 2020-01-26T15:19:02.730 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-01-26T15:19:02.731 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.732 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.733 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.734 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:02.792 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.068) 0:01:52.934 ******** 2020-01-26T15:19:02.796 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:02.798 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:19:02.839 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.047) 0:01:52.982 ******** 2020-01-26T15:19:02.920 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-26T15:19:02.921 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:19:02.962 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:02 +0000 (0:00:00.123) 0:01:53.105 ******** 2020-01-26T15:19:02.969 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-01-26T15:19:02.970 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003286", "end": "2020-01-26 15:19:02.898668", "rc": 0, "start": "2020-01-26 15:19:02.895382", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-01-26T15:19:03.015 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.052) 0:01:53.158 ******** 2020-01-26T15:19:03.020 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:19:03.021 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009928", "end": "2020-01-26 15:19:02.958025", "rc": 0, "start": "2020-01-26 15:19:02.948097", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:03.023 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.065 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.050) 0:01:53.208 ******** 2020-01-26T15:19:03.103 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.038) 0:01:53.246 ******** 2020-01-26T15:19:03.107 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-01-26T15:19:03.109 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.156 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.052) 0:01:53.299 ******** 2020-01-26T15:19:03.194 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.038) 0:01:53.337 ******** 2020-01-26T15:19:03.199 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:03.200 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item={u'block_used': 13723591, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371517, u'size_available': 927217733632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371517, "block_size": 4096, "block_total": 240095108, "block_used": 13723591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217733632, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:19:03.201 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:19:03.242 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.047) 0:01:53.385 ******** 2020-01-26T15:19:03.280 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.037) 0:01:53.422 ******** 2020-01-26T15:19:03.287 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-01-26T15:19:03.288 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.289 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:19:03.291 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS', u'wwn-0x5000c500871b7906'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2MS', u'wwn': u'0x5000c500871b7906', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1', u'wwn-0x5000c500871b7906-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS", "wwn-0x5000c500871b7906"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1", "wwn-0x5000c500871b7906-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2MS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:03.292 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c500871b7906"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.336 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.056) 0:01:53.479 ******** 2020-01-26T15:19:03.343 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.345 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.347 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.348 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.350 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.351 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.364 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.365 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.366 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.407 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.070) 0:01:53.549 ******** 2020-01-26T15:19:03.422 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:19:03.424 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008186", "end": "2020-01-26 15:19:03.426778", "rc": 0, "start": "2020-01-26 15:19:03.418592", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:03.465 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.058) 0:01:53.608 ******** 2020-01-26T15:19:03.512 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-26T15:19:03.513 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'block_used': 13723591, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371517, u'size_available': 927217733632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371517, "block_size": 4096, "block_total": 240095108, "block_used": 13723591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217733632, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.555 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.089) 0:01:53.698 ******** 2020-01-26T15:19:03.581 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:19:03.629 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:03 +0000 (0:00:00.073) 0:01:53.772 ******** 2020-01-26T15:19:03.677 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:19:03.679 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGTA', u'wwn-0x5000c5009292d832'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGTA', u'wwn': u'0x5000c5009292d832', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGTA-part1', u'wwn-0x5000c5009292d832-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGTA", "wwn-0x5000c5009292d832"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGTA-part1", "wwn-0x5000c5009292d832-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGTA", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:03.680 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c5009292d832"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.692 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.693 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.705 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.731 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.732 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.742 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.754 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:03.766 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.278 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-01-26T15:19:04.279 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:19:04.320 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.690) 0:01:54.463 ******** 2020-01-26T15:19:04.346 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-01-26T15:19:04.348 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.388 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.067) 0:01:54.530 ******** 2020-01-26T15:19:04.435 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:04.437 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item={u'block_used': 13723587, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371521, u'size_available': 927217750016, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371521, "block_size": 4096, "block_total": 240095108, "block_used": 13723587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217750016, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2020-01-26T15:19:04.499 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.111) 0:01:54.642 ******** 2020-01-26T15:19:04.664 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-01-26T15:19:04.666 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010974", "end": "2020-01-26 15:19:04.629083", "rc": 0, "start": "2020-01-26 15:19:04.618109", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:04.706 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.207) 0:01:54.849 ******** 2020-01-26T15:19:04.763 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-01-26T15:19:04.766 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'block_used': 13723587, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371521, u'size_available': 927217750016, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371521, "block_size": 4096, "block_total": 240095108, "block_used": 13723587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217750016, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.806 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.100) 0:01:54.949 ******** 2020-01-26T15:19:04.833 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-01-26T15:19:04.875 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:04 +0000 (0:00:00.068) 0:01:55.017 ******** 2020-01-26T15:19:04.924 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:19:04.926 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP2E', u'wwn-0x5000c50092941a36'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XP2E', u'wwn': u'0x5000c50092941a36', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1', u'wwn-0x5000c50092941a36-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E", "wwn-0x5000c50092941a36"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1", "wwn-0x5000c50092941a36-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP2E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:04.928 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092941a36"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.928 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.940 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.951 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.953 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.965 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.977 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:04.989 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:05.001 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:05.583 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-ouxw0L-tu0E-OkRd-m0T9-Vl8H-3mgO-lKL4Ya', u'nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN', u'nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.086210", "end": "2020-01-26 15:19:05.550455", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-ouxw0L-tu0E-OkRd-m0T9-Vl8H-3mgO-lKL4Ya", "nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN", "nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:03.464245", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2020-01-26T15:19:05.585 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:05.806 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-kDyaDE-B95E-M84r-u8LU-sS19-tGfu-cFAYy2', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300HY400BGN', u'nvme-nvme.8086-43564654363233333030485934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.920469", "end": "2020-01-26 15:19:05.800957", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kDyaDE-B95E-M84r-u8LU-sS19-tGfu-cFAYy2", "nvme-INTEL_SSDPEDMD400G4_CVFT623300HY400BGN", "nvme-nvme.8086-43564654363233333030485934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:03.880488", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-26T15:19:05.807 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:06.866 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsrhJWjT3lRYksLdErv5ON5wjy2zHkJ2fx'], u'uuids': [u'ebd1efbb-ac15-4ccd-812f-9b94c6a92ba0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.161793", "end": "2020-01-26 15:19:06.840412", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsrhJWjT3lRYksLdErv5ON5wjy2zHkJ2fx"], "labels": [], "masters": [], "uuids": ["ebd1efbb-ac15-4ccd-812f-9b94c6a92ba0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:05.678619", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:07.069 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zn79vrwBhKjQlavnwnSXScnWkjalXCL0I9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.122523", "end": "2020-01-26 15:19:07.058032", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zn79vrwBhKjQlavnwnSXScnWkjalXCL0I9"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:05.935509", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:07.123 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gpjhSE-jrUl-Cgny-dIfb-WT1K-1mEf-GiYyU6', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN', u'nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.993442", "end": "2020-01-26 15:19:07.081704", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gpjhSE-jrUl-Cgny-dIfb-WT1K-1mEf-GiYyU6", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN", "nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:05.088262", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-01-26T15:19:07.125 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:08.102 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsPmz9jUREoAWUxEdeTNxnQQT5aiZSwMf8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.106920", "end": "2020-01-26 15:19:08.077976", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsPmz9jUREoAWUxEdeTNxnQQT5aiZSwMf8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:06.971056", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:08.322 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znTEtdtUKvdjStTGOZyc72rzgC0FTaaHYQ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.124497", "end": "2020-01-26 15:19:08.308500", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znTEtdtUKvdjStTGOZyc72rzgC0FTaaHYQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:07.184003", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:08.365 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9Cvg9I11nTkMR5VzzIptmVu03NoRYsJAiR'], u'uuids': [u'1fba94d9-f3a9-4c5b-8990-8b892c2c4eed']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.122471", "end": "2020-01-26 15:19:08.325710", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9Cvg9I11nTkMR5VzzIptmVu03NoRYsJAiR"], "labels": [], "masters": [], "uuids": ["1fba94d9-f3a9-4c5b-8990-8b892c2c4eed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:07.203239", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:09.365 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWshd2x9n7vwodUJoQascTkff4McnjQbxB5'], u'uuids': [u'647d848f-83f8-4fbc-856e-53c5e7890896']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.114677", "end": "2020-01-26 15:19:09.328260", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWshd2x9n7vwodUJoQascTkff4McnjQbxB5"], "labels": [], "masters": [], "uuids": ["647d848f-83f8-4fbc-856e-53c5e7890896"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:08.213583", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:09.555 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zndUdDktNggYgUd2rwoP3lC6O0yiG8j6l5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.119502", "end": "2020-01-26 15:19:09.552141", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zndUdDktNggYgUd2rwoP3lC6O0yiG8j6l5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:08.432639", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:09.615 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C8VzpoLcKP6cg6MHY5ylH30AVW5AfzIKz'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.119458", "end": "2020-01-26 15:19:09.568114", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C8VzpoLcKP6cg6MHY5ylH30AVW5AfzIKz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:08.448656", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:10.763 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsUV2xxfAiNOsayfFc5027ClM92jwpcYbN'], u'uuids': [u'd274e1f9-cf1c-4139-9321-bdd7e17513b6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.264753", "end": "2020-01-26 15:19:10.738618", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsUV2xxfAiNOsayfFc5027ClM92jwpcYbN"], "labels": [], "masters": [], "uuids": ["d274e1f9-cf1c-4139-9321-bdd7e17513b6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:09.473865", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:10.817 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znrHHmvkvXC1pH1LayzsLF45D6FuWMEXhO'], u'uuids': [u'42f25fab-e1a0-476a-a4ea-0e986a069724']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122730", "end": "2020-01-26 15:19:10.803333", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znrHHmvkvXC1pH1LayzsLF45D6FuWMEXhO"], "labels": [], "masters": [], "uuids": ["42f25fab-e1a0-476a-a4ea-0e986a069724"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:09.680603", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:10.840 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CPknRQc21lEdHYlFsY7B0QB2O27TTqzdo'], u'uuids': [u'2d043235-7809-4779-8330-124a8e2e0408']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.115778", "end": "2020-01-26 15:19:10.809296", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CPknRQc21lEdHYlFsY7B0QB2O27TTqzdo"], "labels": [], "masters": [], "uuids": ["2d043235-7809-4779-8330-124a8e2e0408"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:09.693518", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:12.020 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsWyQG5Rso0azCoi5GnqzqGXTGDhozZUcD'], u'uuids': [u'd1b506e5-787d-4ddf-a002-b5caaa9f3e0c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.130779", "end": "2020-01-26 15:19:11.995412", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsWyQG5Rso0azCoi5GnqzqGXTGDhozZUcD"], "labels": [], "masters": [], "uuids": ["d1b506e5-787d-4ddf-a002-b5caaa9f3e0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:10.864633", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:12.111 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:12 +0000 (0:00:07.235) 0:02:02.253 ******** 2020-01-26T15:19:12.121 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CR1l6hmTM6MiWYsJ6KiZWktc8uhEwevXW'], u'uuids': [u'3f66b39c-1182-4117-aefc-faeb0035b3ff']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.125519", "end": "2020-01-26 15:19:12.053096", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CR1l6hmTM6MiWYsJ6KiZWktc8uhEwevXW"], "labels": [], "masters": [], "uuids": ["3f66b39c-1182-4117-aefc-faeb0035b3ff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:10.927577", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:12.125 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znT2P33QqJa1Lj04PjgsvqOCiMqn0BM5v6'], u'uuids': [u'8f6d3306-8d59-4d73-a0ff-1d7d9b603e97']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.120543", "end": "2020-01-26 15:19:12.087038", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znT2P33QqJa1Lj04PjgsvqOCiMqn0BM5v6"], "labels": [], "masters": [], "uuids": ["8f6d3306-8d59-4d73-a0ff-1d7d9b603e97"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:10.966495", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:12.203 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:12 +0000 (0:00:00.092) 0:02:02.346 ******** 2020-01-26T15:19:12.210 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:12.211 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS', u'wwn-0x5000c500871b7906'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2MS', u'wwn': u'0x5000c500871b7906', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1', u'wwn-0x5000c500871b7906-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS", "wwn-0x5000c500871b7906"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1", "wwn-0x5000c500871b7906-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2MS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:12.213 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c500871b7906"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.215 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.217 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.218 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.220 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.222 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.223 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.236 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.248 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.249 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGTA', u'wwn-0x5000c5009292d832'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGTA', u'wwn': u'0x5000c5009292d832', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGTA-part1', u'wwn-0x5000c5009292d832-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGTA", "wwn-0x5000c5009292d832"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGTA-part1", "wwn-0x5000c5009292d832-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGTA", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:12.251 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c5009292d832"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.261 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.274 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.276 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.298 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.300 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.311 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.323 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.335 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:12.441 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-ouxw0L-tu0E-OkRd-m0T9-Vl8H-3mgO-lKL4Ya', u'nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN', u'nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.063367", "end": "2020-01-26 15:19:12.410209", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-ouxw0L-tu0E-OkRd-m0T9-Vl8H-3mgO-lKL4Ya", "nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN", "nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.346842", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2020-01-26T15:19:12.443 INFO:teuthology.task.ansible.out: 0.0418306 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0418306 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:12.518 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-kDyaDE-B95E-M84r-u8LU-sS19-tGfu-cFAYy2', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300HY400BGN', u'nvme-nvme.8086-43564654363233333030485934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.060921", "end": "2020-01-26 15:19:12.516434", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-kDyaDE-B95E-M84r-u8LU-sS19-tGfu-cFAYy2", "nvme-INTEL_SSDPEDMD400G4_CVFT623300HY400BGN", "nvme-nvme.8086-43564654363233333030485934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.455513", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-26T15:19:12.520 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0407838 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0407838 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:12.660 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsrhJWjT3lRYksLdErv5ON5wjy2zHkJ2fx'], u'uuids': [u'ebd1efbb-ac15-4ccd-812f-9b94c6a92ba0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.105502", "end": "2020-01-26 15:19:12.637230", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsrhJWjT3lRYksLdErv5ON5wjy2zHkJ2fx"], "labels": [], "masters": [], "uuids": ["ebd1efbb-ac15-4ccd-812f-9b94c6a92ba0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.531728", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.101311 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.101311 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:12.798 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zn79vrwBhKjQlavnwnSXScnWkjalXCL0I9'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152783", "end": "2020-01-26 15:19:12.794325", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zn79vrwBhKjQlavnwnSXScnWkjalXCL0I9"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.641542", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148467 s, 777 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148467 s, 777 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:12.905 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsPmz9jUREoAWUxEdeTNxnQQT5aiZSwMf8'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.110043", "end": "2020-01-26 15:19:12.874290", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsPmz9jUREoAWUxEdeTNxnQQT5aiZSwMf8"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.764247", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.105449 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.105449 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.083 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znTEtdtUKvdjStTGOZyc72rzgC0FTaaHYQ'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160915", "end": "2020-01-26 15:19:13.074637", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znTEtdtUKvdjStTGOZyc72rzgC0FTaaHYQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.913722", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156841 s, 735 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156841 s, 735 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.137 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWshd2x9n7vwodUJoQascTkff4McnjQbxB5'], u'uuids': [u'647d848f-83f8-4fbc-856e-53c5e7890896']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.109045", "end": "2020-01-26 15:19:13.110710", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWshd2x9n7vwodUJoQascTkff4McnjQbxB5"], "labels": [], "masters": [], "uuids": ["647d848f-83f8-4fbc-856e-53c5e7890896"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.001665", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106202 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106202 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.350 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-01-26T15:19:13.351 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C6Tbjbe9gCKhr3nz9AbGToPSp2N39ZlQL'], u'uuids': [u'cdd03c9f-3d33-430b-98b5-93b5cdeb5a6d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.119455", "end": "2020-01-26 15:19:13.309981", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C6Tbjbe9gCKhr3nz9AbGToPSp2N39ZlQL"], "labels": [], "masters": [], "uuids": ["cdd03c9f-3d33-430b-98b5-93b5cdeb5a6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:12.190526", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-01-26T15:19:13.371 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:13.371 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsUV2xxfAiNOsayfFc5027ClM92jwpcYbN'], u'uuids': [u'd274e1f9-cf1c-4139-9321-bdd7e17513b6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.109723", "end": "2020-01-26 15:19:13.338066", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsUV2xxfAiNOsayfFc5027ClM92jwpcYbN"], "labels": [], "masters": [], "uuids": ["d274e1f9-cf1c-4139-9321-bdd7e17513b6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.228343", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.105258 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.105258 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.373 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zndUdDktNggYgUd2rwoP3lC6O0yiG8j6l5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157704", "end": "2020-01-26 15:19:13.362581", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31zndUdDktNggYgUd2rwoP3lC6O0yiG8j6l5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.204877", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152891 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152891 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.420 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:13 +0000 (0:00:01.216) 0:02:03.562 ******** 2020-01-26T15:19:13.467 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP2E', u'wwn-0x5000c50092941a36'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XP2E', u'wwn': u'0x5000c50092941a36', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1', u'wwn-0x5000c50092941a36-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E", "wwn-0x5000c50092941a36"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP2E-part1", "wwn-0x5000c50092941a36-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP2E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2020-01-26T15:19:13.469 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092941a36"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.479 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.491 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.503 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.505 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.517 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.529 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.531 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.542 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:13.600 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsWyQG5Rso0azCoi5GnqzqGXTGDhozZUcD'], u'uuids': [u'd1b506e5-787d-4ddf-a002-b5caaa9f3e0c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.112387", "end": "2020-01-26 15:19:13.566894", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-EPO8weq1VDLMkZanraoOy1YYou7tONWsWyQG5Rso0azCoi5GnqzqGXTGDhozZUcD"], "labels": [], "masters": [], "uuids": ["d1b506e5-787d-4ddf-a002-b5caaa9f3e0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.454507", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1077 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1077 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.659 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:13 +0000 (0:00:00.239) 0:02:03.802 ******** 2020-01-26T15:19:13.666 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znrHHmvkvXC1pH1LayzsLF45D6FuWMEXhO'], u'uuids': [u'42f25fab-e1a0-476a-a4ea-0e986a069724']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.156063", "end": "2020-01-26 15:19:13.648925", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znrHHmvkvXC1pH1LayzsLF45D6FuWMEXhO"], "labels": [], "masters": [], "uuids": ["42f25fab-e1a0-476a-a4ea-0e986a069724"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.492862", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151319 s, 762 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151319 s, 762 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.735 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-gpjhSE-jrUl-Cgny-dIfb-WT1K-1mEf-GiYyU6', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN', u'nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.062134", "end": "2020-01-26 15:19:13.698180", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-gpjhSE-jrUl-Cgny-dIfb-WT1K-1mEf-GiYyU6", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GD400BGN", "nvme-nvme.8086-43564654363233333030474434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.636046", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-01-26T15:19:13.736 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0409304 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0409304 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.935 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-26T15:19:13.936 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.133116", "end": "2020-01-26 15:19:13.902262", "rc": 0, "start": "2020-01-26 15:19:13.769146", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:13.977 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:13 +0000 (0:00:00.317) 0:02:04.119 ******** 2020-01-26T15:19:13.983 INFO:teuthology.task.ansible.out: 2020-01-26T15:19:13.985 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znT2P33QqJa1Lj04PjgsvqOCiMqn0BM5v6'], u'uuids': [u'8f6d3306-8d59-4d73-a0ff-1d7d9b603e97']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157050", "end": "2020-01-26 15:19:13.945267", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-1Ia3GukGznsnbJuPmJ0GuAylakRc31znT2P33QqJa1Lj04PjgsvqOCiMqn0BM5v6"], "labels": [], "masters": [], "uuids": ["8f6d3306-8d59-4d73-a0ff-1d7d9b603e97"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.788217", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154165 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154165 s, 748 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.044 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.067) 0:02:04.187 ******** 2020-01-26T15:19:14.051 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9Cvg9I11nTkMR5VzzIptmVu03NoRYsJAiR'], u'uuids': [u'1fba94d9-f3a9-4c5b-8990-8b892c2c4eed']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.149204", "end": "2020-01-26 15:19:13.973183", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9Cvg9I11nTkMR5VzzIptmVu03NoRYsJAiR"], "labels": [], "masters": [], "uuids": ["1fba94d9-f3a9-4c5b-8990-8b892c2c4eed"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:13.823979", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144663 s, 797 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144663 s, 797 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.211 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-26T15:19:14.213 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.084498", "end": "2020-01-26 15:19:14.183000", "rc": 0, "start": "2020-01-26 15:19:14.098502", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.252 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.206) 0:02:04.394 ******** 2020-01-26T15:19:14.278 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:19:14.330 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.078) 0:02:04.473 ******** 2020-01-26T15:19:14.335 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:14.336 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C8VzpoLcKP6cg6MHY5ylH30AVW5AfzIKz'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.167556", "end": "2020-01-26 15:19:14.279160", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C8VzpoLcKP6cg6MHY5ylH30AVW5AfzIKz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:14.111604", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162785 s, 709 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162785 s, 709 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.358 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-26T15:19:14.360 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi129.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.156928", "end": "2020-01-26 15:19:14.349116", "rc": 0, "start": "2020-01-26 15:19:14.192188", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.418 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.087) 0:02:04.560 ******** 2020-01-26T15:19:14.458 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.040) 0:02:04.601 ******** 2020-01-26T15:19:14.463 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-01-26T15:19:14.465 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.507 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.049) 0:02:04.650 ******** 2020-01-26T15:19:14.533 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:19:14.535 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.577 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.069) 0:02:04.720 ******** 2020-01-26T15:19:14.597 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:14.598 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CPknRQc21lEdHYlFsY7B0QB2O27TTqzdo'], u'uuids': [u'2d043235-7809-4779-8330-124a8e2e0408']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157714", "end": "2020-01-26 15:19:14.557411", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CPknRQc21lEdHYlFsY7B0QB2O27TTqzdo"], "labels": [], "masters": [], "uuids": ["2d043235-7809-4779-8330-124a8e2e0408"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:14.399697", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152961 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152961 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.610 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:19:14.611 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.654 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.076) 0:02:04.796 ******** 2020-01-26T15:19:14.659 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-26T15:19:14.660 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051204", "end": "2020-01-26 15:19:14.644631", "rc": 0, "start": "2020-01-26 15:19:14.593427", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.702 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.047) 0:02:04.844 ******** 2020-01-26T15:19:14.727 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:19:14.771 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.069) 0:02:04.914 ******** 2020-01-26T15:19:14.797 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-26T15:19:14.799 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.840 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.068) 0:02:04.983 ******** 2020-01-26T15:19:14.883 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.042) 0:02:05.026 ******** 2020-01-26T15:19:14.890 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:14.892 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CR1l6hmTM6MiWYsJ6KiZWktc8uhEwevXW'], u'uuids': [u'3f66b39c-1182-4117-aefc-faeb0035b3ff']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157357", "end": "2020-01-26 15:19:14.838557", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9CR1l6hmTM6MiWYsJ6KiZWktc8uhEwevXW"], "labels": [], "masters": [], "uuids": ["3f66b39c-1182-4117-aefc-faeb0035b3ff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:14.681200", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152523 s, 756 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152523 s, 756 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:14.895 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:14.895 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 13723595, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371513, u'size_available': 927217717248, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905893, u'device': u'/dev/sda1', u'inode_used': 149083, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371513, "block_size": 4096, "block_total": 240095108, "block_used": 13723595, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905893, "inode_total": 61054976, "inode_used": 149083, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217717248, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.937 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.053) 0:02:05.080 ******** 2020-01-26T15:19:14.948 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:14.985 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:14 +0000 (0:00:00.047) 0:02:05.127 ******** 2020-01-26T15:19:14.990 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-26T15:19:14.991 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.033 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.047) 0:02:05.175 ******** 2020-01-26T15:19:15.039 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:19:15.041 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.083 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.049) 0:02:05.225 ******** 2020-01-26T15:19:15.089 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:15.090 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.131 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.047) 0:02:05.273 ******** 2020-01-26T15:19:15.137 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:19:15.138 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.183 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.050) 0:02:05.324 ******** 2020-01-26T15:19:15.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:15.189 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.191 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-01-26T15:19:15.191 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C6Tbjbe9gCKhr3nz9AbGToPSp2N39ZlQL'], u'uuids': [u'cdd03c9f-3d33-430b-98b5-93b5cdeb5a6d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158391", "end": "2020-01-26 15:19:15.131354", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-3DdW2VcoOor2r8YGfnkeugt6nXSuWc9C6Tbjbe9gCKhr3nz9AbGToPSp2N39ZlQL"], "labels": [], "masters": [], "uuids": ["cdd03c9f-3d33-430b-98b5-93b5cdeb5a6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-01-26 15:19:14.972963", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153505 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153505 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:15.245 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.063) 0:02:05.388 ******** 2020-01-26T15:19:15.284 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.039) 0:02:05.427 ******** 2020-01-26T15:19:15.291 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:19:15.291 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.333 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.049) 0:02:05.476 ******** 2020-01-26T15:19:15.340 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-26T15:19:15.340 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:19:15.383 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.049) 0:02:05.525 ******** 2020-01-26T15:19:15.390 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-26T15:19:15.390 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.435 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.051) 0:02:05.577 ******** 2020-01-26T15:19:15.441 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:15.442 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={u'block_used': 13723591, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371517, u'size_available': 927217733632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371517, "block_size": 4096, "block_total": 240095108, "block_used": 13723591, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217733632, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.484 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.049) 0:02:05.627 ******** 2020-01-26T15:19:15.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:19:15.492 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.532 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.047) 0:02:05.675 ******** 2020-01-26T15:19:15.538 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-26T15:19:15.540 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.580 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.048) 0:02:05.723 ******** 2020-01-26T15:19:15.587 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-01-26T15:19:15.589 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141092", "end": "2020-01-26 15:19:15.525649", "rc": 0, "start": "2020-01-26 15:19:15.384557", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:15.629 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.048) 0:02:05.771 ******** 2020-01-26T15:19:15.635 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:15.637 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.676 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.047) 0:02:05.819 ******** 2020-01-26T15:19:15.724 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:15.725 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.771 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.095) 0:02:05.914 ******** 2020-01-26T15:19:15.798 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:19:15.800 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.846 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.075) 0:02:05.989 ******** 2020-01-26T15:19:15.854 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-01-26T15:19:15.855 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.064340", "end": "2020-01-26 15:19:15.792846", "rc": 0, "start": "2020-01-26 15:19:15.728506", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:15.900 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.052) 0:02:06.042 ******** 2020-01-26T15:19:15.906 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-26T15:19:15.908 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:15.947 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.047) 0:02:06.090 ******** 2020-01-26T15:19:15.953 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-01-26T15:19:15.999 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:15 +0000 (0:00:00.052) 0:02:06.142 ******** 2020-01-26T15:19:16.005 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:19:16.006 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.050 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.050) 0:02:06.192 ******** 2020-01-26T15:19:16.055 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-01-26T15:19:16.055 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.137 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.087) 0:02:06.280 ******** 2020-01-26T15:19:16.143 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-26T15:19:16.144 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:19:16.186 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.048) 0:02:06.328 ******** 2020-01-26T15:19:16.192 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-01-26T15:19:16.193 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.233 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.047) 0:02:06.376 ******** 2020-01-26T15:19:16.259 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:19:16.261 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.303 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.069) 0:02:06.446 ******** 2020-01-26T15:19:16.339 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-01-26T15:19:16.341 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.381 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.078) 0:02:06.524 ******** 2020-01-26T15:19:16.386 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-26T15:19:16.387 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:19:16.431 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.049) 0:02:06.574 ******** 2020-01-26T15:19:16.513 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-01-26T15:19:16.514 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-01-26T15:19:16.557 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.125) 0:02:06.700 ******** 2020-01-26T15:19:16.596 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-01-26T15:19:16.597 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={u'block_used': 13723587, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226371521, u'size_available': 927217750016, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905894, u'device': u'/dev/sda1', u'inode_used': 149082, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226371521, "block_size": 4096, "block_total": 240095108, "block_used": 13723587, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905894, "inode_total": 61054976, "inode_used": 149082, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927217750016, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.665 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.108) 0:02:06.808 ******** 2020-01-26T15:19:16.693 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-01-26T15:19:16.695 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.763 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.097) 0:02:06.905 ******** 2020-01-26T15:19:16.767 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:16.768 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:16.770 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:16.814 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.843 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.080) 0:02:06.986 ******** 2020-01-26T15:19:16.870 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:16.870 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.917 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.073) 0:02:07.059 ******** 2020-01-26T15:19:16.943 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-01-26T15:19:16.944 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:16.982 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:16 +0000 (0:00:00.065) 0:02:07.125 ******** 2020-01-26T15:19:16.988 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:16.989 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:16.990 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.012 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-01-26T15:19:17.014 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:17.054 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.071) 0:02:07.197 ******** 2020-01-26T15:19:17.080 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-01-26T15:19:17.082 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:17.122 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.066) 0:02:07.264 ******** 2020-01-26T15:19:17.211 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:17.212 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.258 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.465 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-01-26T15:19:17.466 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-01-26T15:19:17.511 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.389) 0:02:07.654 ******** 2020-01-26T15:19:17.517 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:17.518 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.519 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.738 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.800 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.288) 0:02:07.943 ******** 2020-01-26T15:19:17.810 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.815 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:17.857 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.057) 0:02:08.000 ******** 2020-01-26T15:19:17.948 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:19:17.949 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:19:17.989 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:17 +0000 (0:00:00.131) 0:02:08.132 ******** 2020-01-26T15:19:17.994 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:19:18.036 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.047) 0:02:08.179 ******** 2020-01-26T15:19:18.042 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:18.043 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:18.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:18.056 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:18.077 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:18.079 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:18.154 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.219 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.273 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.307 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:18.309 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:18.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:18.343 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.396 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.465 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.509 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.554 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.517) 0:02:08.697 ******** 2020-01-26T15:19:18.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:18.561 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:18.595 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:18.597 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:18.672 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.117) 0:02:08.814 ******** 2020-01-26T15:19:18.700 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-26T15:19:18.701 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:18.743 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.071) 0:02:08.886 ******** 2020-01-26T15:19:18.784 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-26T15:19:18.785 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-26T15:19:18.832 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.088) 0:02:08.975 ******** 2020-01-26T15:19:18.839 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-26T15:19:18.840 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:18.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-01-26T15:19:18.842 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-01-26T15:19:18.895 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.062) 0:02:09.038 ******** 2020-01-26T15:19:18.935 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.040) 0:02:09.078 ******** 2020-01-26T15:19:18.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-26T15:19:18.942 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-01-26T15:19:18.994 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:18 +0000 (0:00:00.059) 0:02:09.137 ******** 2020-01-26T15:19:19.076 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-01-26T15:19:19.077 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-01-26T15:19:19.121 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.126) 0:02:09.264 ******** 2020-01-26T15:19:19.163 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:19.165 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:19.266 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-01-26T15:19:19.268 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:19:19.337 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.215) 0:02:09.479 ******** 2020-01-26T15:19:19.341 INFO:teuthology.task.ansible.out: 2020-01-26T15:19:19.348 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:19.349 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:19.351 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi129.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:19:19.420 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.083) 0:02:09.563 ******** 2020-01-26T15:19:19.426 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-01-26T15:19:19.427 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:19.554 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:19.687 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-01-26T15:19:19.732 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.312) 0:02:09.875 ******** 2020-01-26T15:19:19.823 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-01-26T15:19:19.825 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-26T15:19:19.868 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.135) 0:02:10.010 ******** 2020-01-26T15:19:19.911 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.042) 0:02:10.053 ******** 2020-01-26T15:19:19.918 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-01-26T15:19:19.920 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:19.973 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:19 +0000 (0:00:00.062) 0:02:10.116 ******** 2020-01-26T15:19:20.020 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-01-26T15:19:20.022 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:20.077 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.104) 0:02:10.220 ******** 2020-01-26T15:19:20.114 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.036) 0:02:10.257 ******** 2020-01-26T15:19:20.119 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:20.161 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.046) 0:02:10.303 ******** 2020-01-26T15:19:20.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-01-26T15:19:20.243 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:20.281 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.120) 0:02:10.424 ******** 2020-01-26T15:19:20.303 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:20.349 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.067) 0:02:10.492 ******** 2020-01-26T15:19:20.650 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:19:20.695 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.345) 0:02:10.837 ******** 2020-01-26T15:19:20.734 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:19:20.786 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:20 +0000 (0:00:00.087) 0:02:10.925 ******** 2020-01-26T15:19:21.045 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:19:21.097 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:21 +0000 (0:00:00.314) 0:02:11.240 ******** 2020-01-26T15:19:21.118 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:19:21.177 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:21 +0000 (0:00:00.079) 0:02:11.320 ******** 2020-01-26T15:19:21.349 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-01-26T15:19:21.351 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true} 2020-01-26T15:19:21.393 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:21 +0000 (0:00:00.215) 0:02:11.536 ******** 2020-01-26T15:19:21.614 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-01-26T15:19:21.615 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-01-26T15:19:21.669 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:21 +0000 (0:00:00.275) 0:02:11.811 ******** 2020-01-26T15:19:21.811 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-01-26T15:19:21.814 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:21.852 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:21 +0000 (0:00:00.183) 0:02:11.994 ******** 2020-01-26T15:19:21.993 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-01-26T15:19:21.995 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-01-26T15:19:22.048 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.196) 0:02:12.191 ******** 2020-01-26T15:19:22.053 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-01-26T15:19:22.054 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:19:22.055 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:19:22.098 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.049) 0:02:12.241 ******** 2020-01-26T15:19:22.137 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.039) 0:02:12.280 ******** 2020-01-26T15:19:22.320 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-01-26T15:19:22.322 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048664", "end": "2020-01-26 15:19:22.294056", "rc": 0, "start": "2020-01-26 15:19:22.245392", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:19:22.322 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.043947", "end": "2020-01-26 15:19:22.319005", "rc": 0, "start": "2020-01-26 15:19:22.275058", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:19:22.365 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.227) 0:02:12.508 ******** 2020-01-26T15:19:22.405 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.040) 0:02:12.548 ******** 2020-01-26T15:19:22.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-26T15:19:22.412 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-01-26T15:19:22.465 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.060) 0:02:12.608 ******** 2020-01-26T15:19:22.504 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.038) 0:02:12.647 ******** 2020-01-26T15:19:22.509 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:22.511 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:22.551 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.047) 0:02:12.694 ******** 2020-01-26T15:19:22.597 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.041) 0:02:12.736 ******** 2020-01-26T15:19:22.621 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:22.664 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.070) 0:02:12.806 ******** 2020-01-26T15:19:22.877 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-01-26T15:19:22.878 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-01-26T15:19:22.943 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:22 +0000 (0:00:00.279) 0:02:13.086 ******** 2020-01-26T15:19:23.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:19:23.427 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:19:23.466 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.523) 0:02:13.609 ******** 2020-01-26T15:19:23.493 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:19:23.495 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:23.543 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.076) 0:02:13.686 ******** 2020-01-26T15:19:23.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:19:23.550 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:19:23.604 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.061) 0:02:13.747 ******** 2020-01-26T15:19:23.641 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:19:23.643 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:23.691 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.085) 0:02:13.833 ******** 2020-01-26T15:19:23.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-01-26T15:19:23.810 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:19:23.850 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.160) 0:02:13.993 ******** 2020-01-26T15:19:23.877 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:19:23.878 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:19:23.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.070) 0:02:14.064 ******** 2020-01-26T15:19:23.948 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-01-26T15:19:23.950 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:23.989 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:23 +0000 (0:00:00.068) 0:02:14.132 ******** 2020-01-26T15:19:24.037 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-01-26T15:19:24.038 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046367", "end": "2020-01-26 15:19:24.002930", "rc": 0, "start": "2020-01-26 15:19:23.956563", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-01-26T15:19:24.087 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.097) 0:02:14.230 ******** 2020-01-26T15:19:24.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:19:24.093 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:19:24.135 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.048) 0:02:14.278 ******** 2020-01-26T15:19:24.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-01-26T15:19:24.143 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:24.185 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.049) 0:02:14.328 ******** 2020-01-26T15:19:24.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-01-26T15:19:24.192 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:24.236 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.051) 0:02:14.379 ******** 2020-01-26T15:19:24.243 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:19:24.246 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:51 UTC", "ActiveEnterTimestampMonotonic": "26240384", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket -.mount system.slice sysinit.target systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:44 UTC", "AssertTimestampMonotonic": "17900058", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:44 UTC", "ConditionTimestampMonotonic": "17900058", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:19:24.247 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1830", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:51 UTC", "ExecMainStartTimestampMonotonic": "26240333", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:44 UTC", "InactiveExitTimestampMonotonic": "17900838", "InvocationID": "b1677edea97f4ab8a5a2a5a9a848c444", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:19:24.249 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1830", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:51 UTC", "StateChangeTimestampMonoton 2020-01-26T15:19:24.252 INFO:teuthology.task.ansible.out:ic": "26240384", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:51 UTC", "WatchdogTimestampMonotonic": "26240381", "WatchdogUSec": "0"}} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:24.291 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.054) 0:02:14.434 ******** 2020-01-26T15:19:24.332 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.040) 0:02:14.475 ******** 2020-01-26T15:19:24.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-26T15:19:24.339 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:24.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.045) 0:02:14.521 ******** 2020-01-26T15:19:24.448 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:19:24.450 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ActiveEnterTimestampMonotonic": "25303768", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service system.slice -.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:16:37 UTC", "AssertTimestampMonotonic": "16932150", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:16:37 UTC", "ConditionTimestampMonotonic": "16932150", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:19:24.451 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1914", "ExecMainStartTimestamp": "Sun 2020-01-26 15:16:45 UTC", "ExecMainStartTimestampMonotonic": "25303755", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:16:37 UTC", "InactiveExitTimestampMonotonic": "16932903", "InvocationID": "78b5f70065044a19a0e825358a494fae", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:19:24.453 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1914", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:16:45 UTC", "StateChangeTimestampMonoton 2020-01-26T15:19:24.455 INFO:teuthology.task.ansible.out:ic": "25303768", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:16:45 UTC", "WatchdogTimestampMonotonic": "25303767", "WatchdogUSec": "0"}} 2020-01-26T15:19:24.490 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.111) 0:02:14.633 ******** 2020-01-26T15:19:24.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-26T15:19:24.517 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:24.556 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:24 +0000 (0:00:00.066) 0:02:14.699 ******** 2020-01-26T15:19:25.200 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-01-26T15:19:25.201 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:19:25.245 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.688) 0:02:15.387 ******** 2020-01-26T15:19:25.272 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-01-26T15:19:25.273 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:25.318 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.073) 0:02:15.461 ******** 2020-01-26T15:19:25.325 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-01-26T15:19:25.326 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"cache_update_time": 1580051653, "cache_updated": false, "changed": false} 2020-01-26T15:19:25.378 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.059) 0:02:15.520 ******** 2020-01-26T15:19:25.384 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"cache_update_time": 1580051568, "cache_updated": false, "changed": false} 2020-01-26T15:19:25.428 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.050) 0:02:15.571 ******** 2020-01-26T15:19:25.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-26T15:19:25.435 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:25.480 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.051) 0:02:15.623 ******** 2020-01-26T15:19:25.486 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:25.530 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.050) 0:02:15.673 ******** 2020-01-26T15:19:25.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-01-26T15:19:25.610 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:25.667 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.137) 0:02:15.810 ******** 2020-01-26T15:19:25.673 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-01-26T15:19:25.674 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-01-26T15:19:25.675 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:25.724 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.056) 0:02:15.867 ******** 2020-01-26T15:19:25.770 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.044) 0:02:15.912 ******** 2020-01-26T15:19:25.798 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-01-26T15:19:25.799 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:25.842 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:25 +0000 (0:00:00.072) 0:02:15.985 ******** 2020-01-26T15:19:25.993 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-26T15:19:25.994 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:19:26.038 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:26 +0000 (0:00:00.195) 0:02:16.181 ******** 2020-01-26T15:19:26.044 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:19:26.091 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:26 +0000 (0:00:00.053) 0:02:16.234 ******** 2020-01-26T15:19:26.099 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-01-26T15:19:26.102 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2020-01-26 15:17:08 UTC", "ActiveEnterTimestampMonotonic": "25842951", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target basic.target systemd-journald.socket system.slice -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2020-01-26 15:17:00 UTC", "AssertTimestampMonotonic": "17504058", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2020-01-26 15:17:00 UTC", "ConditionTimestampMonotonic": "17504058", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-01-26T15:19:26.103 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1838", "ExecMainStartTimestamp": "Sun 2020-01-26 15:17:08 UTC", "ExecMainStartTimestampMonotonic": "25842930", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2020-01-26 15:17:00 UTC", "InactiveExitTimestampMonotonic": "17504774", "InvocationID": "780a160aa06f403c84133901d7e58ab7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-01-26T15:19:26.105 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1838", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2020-01-26 15:17:08 UTC", "StateChangeTimestampMonoton 2020-01-26T15:19:26.106 INFO:teuthology.task.ansible.out:ic": "25842951", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2020-01-26 15:17:08 UTC", "WatchdogTimestampMonotonic": "25842949", "WatchdogUSec": "0"}} 2020-01-26T15:19:26.145 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:26 +0000 (0:00:00.054) 0:02:16.288 ******** 2020-01-26T15:19:26.171 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-01-26T15:19:26.173 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:26.217 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:26 +0000 (0:00:00.072) 0:02:16.360 ******** 2020-01-26T15:19:27.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:19:27.098 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.879) 0:02:17.240 ******** 2020-01-26T15:19:27.105 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi204.front.sepia.ceph.com] => {"cache_update_time": 1580051610, "cache_updated": false, "changed": false} 2020-01-26T15:19:27.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:19:27.154 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.056) 0:02:17.297 ******** 2020-01-26T15:19:27.197 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.042) 0:02:17.340 ******** 2020-01-26T15:19:27.223 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-01-26T15:19:27.225 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:27.266 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.068) 0:02:17.409 ******** 2020-01-26T15:19:27.400 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-01-26T15:19:27.402 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-01-26T15:19:27.448 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.182) 0:02:17.591 ******** 2020-01-26T15:19:27.592 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-01-26T15:19:27.594 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:19:27.635 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.186) 0:02:17.777 ******** 2020-01-26T15:19:27.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:19:27.663 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi129.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:19:27.704 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.069) 0:02:17.847 ******** 2020-01-26T15:19:27.753 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.049) 0:02:17.896 ******** 2020-01-26T15:19:27.769 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-01-26T15:19:27.770 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-01-26T15:19:27.819 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.065) 0:02:17.962 ******** 2020-01-26T15:19:27.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:19:27.828 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-01-26T15:19:27.874 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.055) 0:02:18.017 ******** 2020-01-26T15:19:27.883 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-26T15:19:27.884 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580051523.0251505, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580051523.0211504, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580051523.0211504, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:19:27.926 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:27 +0000 (0:00:00.051) 0:02:18.068 ******** 2020-01-26T15:19:28.018 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580051531.820111, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580051530.3088672, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580051530.3088672, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:19:28.058 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.131) 0:02:18.200 ******** 2020-01-26T15:19:28.295 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-01-26T15:19:28.297 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:19:28.298 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:19:28.339 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.281) 0:02:18.482 ******** 2020-01-26T15:19:28.377 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.037) 0:02:18.520 ******** 2020-01-26T15:19:28.383 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-26T15:19:28.384 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:19:28.426 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.049) 0:02:18.569 ******** 2020-01-26T15:19:28.433 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:19:28.481 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.053) 0:02:18.623 ******** 2020-01-26T15:19:28.489 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-01-26T15:19:28.489 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:28.549 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.068) 0:02:18.691 ******** 2020-01-26T15:19:28.554 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:28.555 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-01-26T15:19:28.556 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-01-26T15:19:28.599 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.050) 0:02:18.742 ******** 2020-01-26T15:19:28.643 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.043) 0:02:18.785 ******** 2020-01-26T15:19:28.679 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-01-26T15:19:28.680 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-26T15:19:28.729 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.086) 0:02:18.872 ******** 2020-01-26T15:19:28.735 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-26T15:19:28.780 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.050) 0:02:18.923 ******** 2020-01-26T15:19:28.853 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-01-26T15:19:28.855 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:19:28.898 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.115) 0:02:19.038 ******** 2020-01-26T15:19:28.914 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:19:28.956 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.060) 0:02:19.099 ******** 2020-01-26T15:19:28.961 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-26T15:19:28.963 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.005 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:28 +0000 (0:00:00.048) 0:02:19.147 ******** 2020-01-26T15:19:29.010 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.065 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.060) 0:02:19.208 ******** 2020-01-26T15:19:29.072 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-01-26T15:19:29.073 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.075 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.075 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.077 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.078 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.154 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.088) 0:02:19.297 ******** 2020-01-26T15:19:29.162 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.163 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.164 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.166 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.167 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi204.front.sepia.ceph.com] => {"changed": false} 2020-01-26T15:19:29.224 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.069) 0:02:19.366 ******** 2020-01-26T15:19:29.268 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.043) 0:02:19.410 ******** 2020-01-26T15:19:29.275 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-01-26T15:19:29.277 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.278 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.280 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.281 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.284 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.285 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.287 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.330 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.059) 0:02:19.470 ******** 2020-01-26T15:19:29.336 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-01-26T15:19:29.338 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi129.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.394 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.066) 0:02:19.537 ******** 2020-01-26T15:19:29.445 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.051) 0:02:19.588 ******** 2020-01-26T15:19:29.450 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:29.451 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.451 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.498 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.052) 0:02:19.641 ******** 2020-01-26T15:19:29.541 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.043) 0:02:19.684 ******** 2020-01-26T15:19:29.547 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-01-26T15:19:29.549 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.589 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.048) 0:02:19.732 ******** 2020-01-26T15:19:29.595 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.596 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-01-26T15:19:29.597 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1580051554.4703698, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1580051553.0063698, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1580051553.0063698, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-01-26T15:19:29.637 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.047) 0:02:19.780 ******** 2020-01-26T15:19:29.672 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.035) 0:02:19.815 ******** 2020-01-26T15:19:29.677 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-01-26T15:19:29.682 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.721 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.048) 0:02:19.864 ******** 2020-01-26T15:19:29.760 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.039) 0:02:19.903 ******** 2020-01-26T15:19:29.765 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-01-26T15:19:29.767 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.820 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.060) 0:02:19.963 ******** 2020-01-26T15:19:29.826 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.871 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.050) 0:02:20.014 ******** 2020-01-26T15:19:29.876 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-01-26T15:19:29.877 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-01-26T15:19:29.879 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.921 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.050) 0:02:20.064 ******** 2020-01-26T15:19:29.958 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:29 +0000 (0:00:00.036) 0:02:20.101 ******** 2020-01-26T15:19:29.963 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:29.964 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.007 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.049) 0:02:20.150 ******** 2020-01-26T15:19:30.046 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.038) 0:02:20.189 ******** 2020-01-26T15:19:30.052 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-01-26T15:19:30.052 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-01-26T15:19:30.054 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.098 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.051) 0:02:20.241 ******** 2020-01-26T15:19:30.141 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.043) 0:02:20.284 ******** 2020-01-26T15:19:30.147 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:19:30.149 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.190 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.048) 0:02:20.332 ******** 2020-01-26T15:19:30.233 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.043) 0:02:20.376 ******** 2020-01-26T15:19:30.240 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.282 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.049) 0:02:20.425 ******** 2020-01-26T15:19:30.288 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-01-26T15:19:30.290 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.334 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.051) 0:02:20.476 ******** 2020-01-26T15:19:30.351 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:30.351 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011057", "end": "2020-01-26 15:19:30.316834", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:19:30.305777", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.363 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:19:30.364 INFO:teuthology.task.ansible.out:skipping: [smithi129.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.419 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.085) 0:02:20.562 ******** 2020-01-26T15:19:30.426 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-01-26T15:19:30.426 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-01-26T15:19:30.472 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.053) 0:02:20.615 ******** 2020-01-26T15:19:30.479 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:30.479 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006107", "end": "2020-01-26 15:19:30.444552", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:19:30.438445", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.579 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009277", "end": "2020-01-26 15:19:30.564945", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:19:30.555668", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.597 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005614", "end": "2020-01-26 15:19:30.568925", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:19:30.563311", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.609 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi204.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-01-26T15:19:30.649 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.176) 0:02:20.792 ******** 2020-01-26T15:19:30.676 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-01-26T15:19:30.689 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.733 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.083) 0:02:20.875 ******** 2020-01-26T15:19:30.740 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:30.741 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006054", "end": "2020-01-26 15:19:30.691175", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:19:30.685121", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.754 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021269", "end": "2020-01-26 15:19:30.712375", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:19:30.691106", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.820 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.086) 0:02:20.962 ******** 2020-01-26T15:19:30.826 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-01-26T15:19:30.826 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.828 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.829 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.886 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.066) 0:02:21.029 ******** 2020-01-26T15:19:30.891 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:30.892 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005549", "end": "2020-01-26 15:19:30.835113", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:19:30.829564", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:30.894 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:19:30.935 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.048) 0:02:21.077 ******** 2020-01-26T15:19:30.951 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-01-26T15:19:30.952 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.961 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.962 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:30.964 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi204.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.003 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:30 +0000 (0:00:00.068) 0:02:21.146 ******** 2020-01-26T15:19:31.008 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:31.009 INFO:teuthology.task.ansible.out:ok: [smithi129.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.014750", "end": "2020-01-26 15:19:30.970751", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:19:30.956001", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:31.052 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.048) 0:02:21.194 ******** 2020-01-26T15:19:31.057 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-01-26T15:19:31.059 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.103 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.051) 0:02:21.246 ******** 2020-01-26T15:19:31.108 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:19:31.109 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:19:31.110 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:19:31.175 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.072) 0:02:21.318 ******** 2020-01-26T15:19:31.186 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.254 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.074) 0:02:21.393 ******** 2020-01-26T15:19:31.276 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-01-26T15:19:31.278 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.327 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.076) 0:02:21.470 ******** 2020-01-26T15:19:31.332 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:19:31.333 INFO:teuthology.task.ansible.out:changed: [smithi129.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:19:31.373 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-01-26T15:19:31.375 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.435 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.108) 0:02:21.578 ******** 2020-01-26T15:19:31.461 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-01-26T15:19:31.463 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.512 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.076) 0:02:21.654 ******** 2020-01-26T15:19:31.537 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:19:31.538 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.581 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.069) 0:02:21.724 ******** 2020-01-26T15:19:31.617 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-01-26T15:19:31.619 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.660 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.079) 0:02:21.803 ******** 2020-01-26T15:19:31.686 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-01-26T15:19:31.687 INFO:teuthology.task.ansible.out:skipping: [smithi204.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-01-26T15:19:31.725 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:31 +0000 (0:00:00.064) 0:02:21.867 ******** 2020-01-26T15:19:31.877 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-01-26T15:19:31.879 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011077", "end": "2020-01-26 15:19:31.836399", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-01-26 15:19:31.825322", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:32.003 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005764", "end": "2020-01-26 15:19:31.966470", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-01-26 15:19:31.960706", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:32.138 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005572", "end": "2020-01-26 15:19:32.090722", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-01-26 15:19:32.085150", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:32.284 INFO:teuthology.task.ansible.out:ok: [smithi204.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021984", "end": "2020-01-26 15:19:32.242520", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-01-26 15:19:32.220536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-01-26T15:19:32.336 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:32 +0000 (0:00:00.611) 0:02:22.479 ******** 2020-01-26T15:19:32.362 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-01-26T15:19:32.405 INFO:teuthology.task.ansible.out:Sunday 26 January 2020 15:19:32 +0000 (0:00:00.069) 0:02:22.548 ******** 2020-01-26T15:19:32.537 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-01-26T15:19:32.538 INFO:teuthology.task.ansible.out:changed: [smithi204.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-01-26T15:19:32.662 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-01-26T15:19:32.664 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-01-26T15:19:32.666 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-01-26T15:19:32.669 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi042.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 smithi129.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 smithi204.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=170 rescued=0 ignored=0 Sunday 26 January 2020 15:19:32 +0000 (0:00:00.261) 0:02:22.810 ******** =============================================================================== 2020-01-26T15:19:32.675 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 16.84s users : Update authorized_keys using the keys repo --------------------- 13.56s testnode : Ensure packages are not present. ----------------------------- 9.42s testnode : Install packages --------------------------------------------- 8.72s testnode : Zap all non-root disks --------------------------------------- 7.24s users : Remove revoked users -------------------------------------------- 3.99s Gathering Facts --------------------------------------------------------- 2.67s users : Update authorized_keys for each user with literal keys ---------- 1.61s testnode : Update apt cache. -------------------------------------------- 1.54s testnode : Install python-apt ------------------------------------------- 0.92s testnode : Upgrade packages --------------------------------------------- 0.92s testnode : Install python-pip on apt based systems. --------------------- 0.88s Gathering Facts --------------------------------------------------------- 0.80s common : Update apt cache ----------------------------------------------- 0.74s 2020-01-26T15:19:32.676 INFO:teuthology.task.ansible.out:ansible-managed : Add authorized keys for the ansible user. ------------- 0.72s users : Clone the keys repo --------------------------------------------- 0.72s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.65s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.61s common : Set the hardware clock ----------------------------------------- 0.58s testnode : Ensure perl-doc is installed on apt systems. ----------------- 0.52s 2020-01-26T15:19:32.913 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi204.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2020-01-26T15:19:32.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:19:32.916 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi204.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:19:32.992 INFO:teuthology.orchestra.run.smithi204:> true 2020-01-26T15:19:33.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:19:33.197 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi129.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:19:33.277 INFO:teuthology.orchestra.run.smithi129:> true 2020-01-26T15:19:33.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-01-26T15:19:33.482 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-01-26T15:19:33.557 INFO:teuthology.orchestra.run.smithi042:> true 2020-01-26T15:19:33.759 INFO:teuthology.run_tasks:Running task clock... 2020-01-26T15:19:33.825 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-01-26T15:19:33.825 INFO:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:19:33.879 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:19:33.880 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Command line: ntpd -gq 2020-01-26T15:19:33.881 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: proto: precision = 0.071 usec (-24) 2020-01-26T15:19:33.881 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:33.881 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:33.881 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen normally on 3 enp3s0f1 172.21.15.204:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen normally on 4 lo [::1]:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ab%5]:123 2020-01-26T15:19:33.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:33 ntpd[7626]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:19:33.883 INFO:teuthology.orchestra.run.smithi204.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:33.883 INFO:teuthology.orchestra.run.smithi204.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:34.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:34 ntpd[7626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:34.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:34 ntpd[7626]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:34.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:34 ntpd[7626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:34.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:34 ntpd[7626]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:36.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:36 ntpd[7626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:36.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:36 ntpd[7626]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:36.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:36 ntpd[7626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:36.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:36 ntpd[7626]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:38.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:38 ntpd[7626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:38.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:38 ntpd[7626]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:38.880 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:38 ntpd[7626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:38.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:38 ntpd[7626]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:40.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:40.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:40.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:40.881 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:40.882 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:19:40.882 INFO:teuthology.orchestra.run.smithi204.stderr:26 Jan 15:19:40 ntpd[7626]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:19:40.882 INFO:teuthology.orchestra.run.smithi204.stdout:26 Jan 15:19:40 ntpd[7626]: ntpd: time slew +0.008618 s 2020-01-26T15:19:40.882 INFO:teuthology.orchestra.run.smithi204.stdout:ntpd: time slew +0.008618s 2020-01-26T15:19:40.930 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:19:40.930 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2020-01-26T15:19:40.930 INFO:teuthology.orchestra.run.smithi204.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:40.930 INFO:teuthology.orchestra.run.smithi204.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:40.931 INFO:teuthology.orchestra.run.smithi204.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:40.931 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:40.931 INFO:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:19:40.992 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:19:40.992 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Command line: ntpd -gq 2020-01-26T15:19:40.992 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: proto: precision = 0.123 usec (-23) 2020-01-26T15:19:40.994 INFO:teuthology.orchestra.run.smithi129.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:40.994 INFO:teuthology.orchestra.run.smithi129.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:40.994 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:40.994 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:40.994 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen normally on 3 enp3s0f1 172.21.15.129:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen normally on 4 lo [::1]:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7261%5]:123 2020-01-26T15:19:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:41 ntpd[7787]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:19:44.992 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:45 ntpd[7787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:44.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:45 ntpd[7787]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:44.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:45 ntpd[7787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:44.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:45 ntpd[7787]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:46.992 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:47 ntpd[7787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:46.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:47 ntpd[7787]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:46.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:47 ntpd[7787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:46.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:47 ntpd[7787]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:48.992 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:49 ntpd[7787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:48.992 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:49 ntpd[7787]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:48.992 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:49 ntpd[7787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:48.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:49 ntpd[7787]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:50.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:50.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:50.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:50.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:50.993 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:19:50.994 INFO:teuthology.orchestra.run.smithi129.stderr:26 Jan 15:19:51 ntpd[7787]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:19:50.994 INFO:teuthology.orchestra.run.smithi129.stdout:26 Jan 15:19:51 ntpd[7787]: ntpd: time slew -0.023438 s 2020-01-26T15:19:50.994 INFO:teuthology.orchestra.run.smithi129.stdout:ntpd: time slew -0.023438s 2020-01-26T15:19:51.045 INFO:teuthology.orchestra.run.smithi129.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:19:51.046 INFO:teuthology.orchestra.run.smithi129.stdout:============================================================================== 2020-01-26T15:19:51.046 INFO:teuthology.orchestra.run.smithi129.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:51.046 INFO:teuthology.orchestra.run.smithi129.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:51.046 INFO:teuthology.orchestra.run.smithi129.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:51.046 INFO:teuthology.orchestra.run.smithi129.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:51.047 INFO:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-01-26T15:19:51.113 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-01-26T15:19:51.113 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Command line: ntpd -gq 2020-01-26T15:19:51.114 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: proto: precision = 0.127 usec (-23) 2020-01-26T15:19:51.115 INFO:teuthology.orchestra.run.smithi042.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:51.115 INFO:teuthology.orchestra.run.smithi042.stderr:restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: restrict ::: KOD does nothing without LIMITED. 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen and drop on 0 v6wildcard [::]:123 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen normally on 2 lo 127.0.0.1:123 2020-01-26T15:19:51.116 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen normally on 3 ens1f0 172.21.15.42:123 2020-01-26T15:19:51.117 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen normally on 4 lo [::1]:123 2020-01-26T15:19:51.117 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1440%3]:123 2020-01-26T15:19:51.117 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:51 ntpd[7722]: Listening on routing socket on fd #22 for interface updates 2020-01-26T15:19:53.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:53 ntpd[7722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:53.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:53 ntpd[7722]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:53.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:53 ntpd[7722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:53.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:53 ntpd[7722]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:55 ntpd[7722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:55 ntpd[7722]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:55 ntpd[7722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:55 ntpd[7722]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:57 ntpd[7722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:57 ntpd[7722]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:57 ntpd[7722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:57 ntpd[7722]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-01-26T15:19:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: can't open /var/log/ntpstats/rawstats.20200126: Permission denied 2020-01-26T15:19:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-01-26T15:19:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: can't open /var/log/ntpstats/peerstats.20200126: Permission denied 2020-01-26T15:19:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-01-26T15:19:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:26 Jan 15:19:59 ntpd[7722]: can't open /var/log/ntpstats/loopstats.20200126: Permission denied 2020-01-26T15:19:59.115 INFO:teuthology.orchestra.run.smithi042.stdout:26 Jan 15:19:59 ntpd[7722]: ntpd: time slew -0.001642 s 2020-01-26T15:19:59.115 INFO:teuthology.orchestra.run.smithi042.stdout:ntpd: time slew -0.001642s 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout: remote refid st t when poll reach delay offset jitter 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================== 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:59.162 INFO:teuthology.orchestra.run.smithi042.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-01-26T15:19:59.163 INFO:teuthology.run_tasks:Running task install... 2020-01-26T15:19:59.175 DEBUG:teuthology.task.install:project ceph 2020-01-26T15:19:59.175 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}} 2020-01-26T15:19:59.175 DEBUG:teuthology.task.install:config {'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'extra_packages': ['librados2'], 'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm']} 2020-01-26T15:19:59.175 INFO:teuthology.task.install:Using flavor: basic 2020-01-26T15:19:59.183 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-01-26T15:19:59.183 INFO:teuthology.task.install:extra packages: ['librados2'] 2020-01-26T15:19:59.183 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-01-26T15:19:59.236 INFO:teuthology.orchestra.run.smithi204.stdout:Ubuntu 2020-01-26T15:19:59.242 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.242 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:19:59.243 INFO:teuthology.orchestra.run.smithi204:> sudo apt-key list | grep Ceph 2020-01-26T15:19:59.291 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:19:59.296 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.296 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-01-26T15:19:59.296 INFO:teuthology.orchestra.run.smithi129:> sudo apt-key list | grep Ceph 2020-01-26T15:19:59.333 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:19:59.350 INFO:teuthology.orchestra.run.smithi042.stdout:Ubuntu 2020-01-26T15:19:59.355 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.356 INFO:teuthology.orchestra.run.smithi042:> sudo apt-key list | grep Ceph 2020-01-26T15:19:59.387 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:19:59.390 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:19:59.390 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:19:59.391 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-01-26T15:19:59.443 INFO:teuthology.orchestra.run.smithi204.stdout:Ubuntu 2020-01-26T15:19:59.444 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:19:59.444 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:19:59.445 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:19:59.448 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.448 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:19:59.448 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:19:59.449 INFO:teuthology.packaging:ref: None 2020-01-26T15:19:59.449 INFO:teuthology.packaging:tag: None 2020-01-26T15:19:59.449 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:19:59.449 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:19:59.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:19:59.453 INFO:teuthology.orchestra.run.smithi042.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:19:59.497 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:19:59.502 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.502 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:19:59.503 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:19:59.503 INFO:teuthology.packaging:ref: None 2020-01-26T15:19:59.503 INFO:teuthology.packaging:tag: None 2020-01-26T15:19:59.503 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:19:59.503 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:19:59.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:19:59.507 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:19:59.508 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:19:59.508 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-01-26T15:19:59.576 INFO:teuthology.orchestra.run.smithi042.stdout:Ubuntu 2020-01-26T15:19:59.581 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:19:59.581 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, librados2 on remote deb x86_64 2020-01-26T15:19:59.581 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:19:59.582 INFO:teuthology.packaging:ref: None 2020-01-26T15:19:59.582 INFO:teuthology.packaging:tag: None 2020-01-26T15:19:59.582 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:19:59.582 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:19:59.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:19:59.742 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:19:59.743 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:19:59.749 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:19:59.750 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:19:59.858 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default/ 2020-01-26T15:19:59.858 INFO:teuthology.task.install.deb:Package version is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:19:59.863 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:19:59.877 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:19:59.911 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get update 2020-01-26T15:19:59.943 INFO:teuthology.orchestra.run.smithi204:> sudo apt-get update 2020-01-26T15:19:59.978 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:20:00.026 INFO:teuthology.orchestra.run.smithi042:> sudo apt-get update 2020-01-26T15:20:00.077 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:20:00.119 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-01-26T15:20:00.182 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:20:00.203 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:20:00.205 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:20:00.206 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:20:00.225 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:20:00.226 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:20:00.234 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:20:00.246 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:20:00.249 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:20:00.269 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:20:00.270 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:20:00.282 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:20:00.286 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:20:00.290 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release [7,591 B] 2020-01-26T15:20:00.303 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:20:00.313 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:20:00.314 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:20:00.318 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:20:00.332 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:20:00.334 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main i386 Packages [433 B] 2020-01-26T15:20:00.374 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 Packages [13.8 kB] 2020-01-26T15:20:00.394 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:20:00.400 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-01-26T15:20:00.480 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-01-26T15:20:00.594 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:20:00.719 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 21.8 kB in 1s (37.7 kB/s) 2020-01-26T15:20:00.851 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 274 kB in 1s (373 kB/s) 2020-01-26T15:20:00.941 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 111 kB in 1s (155 kB/s) 2020-01-26T15:20:01.879 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:20:01.926 INFO:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:20:02.003 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2020-01-26T15:20:02.008 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:20:02.054 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:20:02.145 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:20:02.212 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:20:02.245 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2020-01-26T15:20:02.245 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2020-01-26T15:20:02.260 INFO:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.2.8-63-ge1c5fd9-1bionic ceph-mds=13.2.8-63-ge1c5fd9-1bionic ceph-mgr=13.2.8-63-ge1c5fd9-1bionic ceph-common=13.2.8-63-ge1c5fd9-1bionic ceph-fuse=13.2.8-63-ge1c5fd9-1bionic ceph-test=13.2.8-63-ge1c5fd9-1bionic radosgw=13.2.8-63-ge1c5fd9-1bionic python3-rados=13.2.8-63-ge1c5fd9-1bionic python3-rgw=13.2.8-63-ge1c5fd9-1bionic python3-cephfs=13.2.8-63-ge1c5fd9-1bionic python3-rbd=13.2.8-63-ge1c5fd9-1bionic libcephfs2=13.2.8-63-ge1c5fd9-1bionic libcephfs-dev=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic librbd1=13.2.8-63-ge1c5fd9-1bionic rbd-fuse=13.2.8-63-ge1c5fd9-1bionic librados2=13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:20:02.340 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2020-01-26T15:20:02.397 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2020-01-26T15:20:02.399 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.399 INFO:teuthology.orchestra.run.smithi204.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.399 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.399 INFO:teuthology.orchestra.run.smithi204.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.400 INFO:teuthology.orchestra.run.smithi204.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.401 INFO:teuthology.orchestra.run.smithi204.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.401 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:20:02.401 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2020-01-26T15:20:02.401 INFO:teuthology.orchestra.run.smithi204.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:20:02.402 INFO:teuthology.orchestra.run.smithi204.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:20:02.451 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:20:02.452 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:20:02.481 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2020-01-26T15:20:02.481 INFO:teuthology.orchestra.run.smithi204.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:20:02.482 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.482 INFO:teuthology.orchestra.run.smithi204.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.483 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.483 INFO:teuthology.orchestra.run.smithi204.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.483 INFO:teuthology.orchestra.run.smithi204.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.484 INFO:teuthology.orchestra.run.smithi204.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.484 INFO:teuthology.orchestra.run.smithi204.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.484 INFO:teuthology.orchestra.run.smithi204.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.484 INFO:teuthology.orchestra.run.smithi204.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.484 INFO:teuthology.orchestra.run.smithi204.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.485 INFO:teuthology.orchestra.run.smithi204.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.485 INFO:teuthology.orchestra.run.smithi204.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.485 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:20:02.485 INFO:teuthology.orchestra.run.smithi204.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:20:02.485 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2020-01-26T15:20:02.486 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 librbd1 2020-01-26T15:20:02.590 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2020-01-26T15:20:02.590 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2020-01-26T15:20:02.632 INFO:teuthology.orchestra.run.smithi204.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:20:02.632 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:20:02.632 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:20:02.632 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:20:02.651 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2020-01-26T15:20:02.651 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.652 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.653 INFO:teuthology.orchestra.run.smithi129.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.654 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:20:02.656 INFO:teuthology.orchestra.run.smithi129.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:20:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:20:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:20:02.657 INFO:teuthology.orchestra.run.smithi129.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:20:02.758 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2020-01-26T15:20:02.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:20:02.758 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.759 INFO:teuthology.orchestra.run.smithi129.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.760 INFO:teuthology.orchestra.run.smithi129.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.760 INFO:teuthology.orchestra.run.smithi129.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.760 INFO:teuthology.orchestra.run.smithi129.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.760 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:20:02.760 INFO:teuthology.orchestra.run.smithi129.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:20:02.761 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2020-01-26T15:20:02.761 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 librbd1 2020-01-26T15:20:02.761 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2020-01-26T15:20:02.762 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.762 INFO:teuthology.orchestra.run.smithi042.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.762 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.763 INFO:teuthology.orchestra.run.smithi042.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.764 INFO:teuthology.orchestra.run.smithi042.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.764 INFO:teuthology.orchestra.run.smithi042.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.764 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse socat xmlstarlet 2020-01-26T15:20:02.764 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: python-influxdb python-egenix-mxdatetime python-genshi python-jinja2-doc 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: python-cherrypy python-flup python-pecan-doc python-pyinotify-doc 2020-01-26T15:20:02.765 INFO:teuthology.orchestra.run.smithi042.stdout: python-socks python-ntlm python-waitress-doc python-webob-doc 2020-01-26T15:20:02.766 INFO:teuthology.orchestra.run.smithi042.stdout: python-webtest-doc python-pyquery ipython python-redis python-pylibmc 2020-01-26T15:20:02.766 INFO:teuthology.orchestra.run.smithi042.stdout: | python-memcache python-termcolor python-watchdog python-werkzeug-doc 2020-01-26T15:20:02.780 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:20:02.852 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2020-01-26T15:20:02.852 INFO:teuthology.orchestra.run.smithi042.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:20:02.852 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-01-26T15:20:02.852 INFO:teuthology.orchestra.run.smithi042.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 2020-01-26T15:20:02.853 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 python-bcrypt python-bs4 2020-01-26T15:20:02.853 INFO:teuthology.orchestra.run.smithi042.stdout: python-ceph-argparse python-cephfs python-certifi python-chardet 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-cherrypy3 python-dnspython python-formencode python-html5lib 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-jinja2 python-logutils python-lxml python-mako python-markupsafe 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-prettytable 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-pyinotify python-rados python-rbd python-repoze.lru python-requests 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-rgw python-routes python-scgi python-simplegeneric python-simplejson 2020-01-26T15:20:02.854 INFO:teuthology.orchestra.run.smithi042.stdout: python-singledispatch python-tempita python-urllib3 python-waitress 2020-01-26T15:20:02.855 INFO:teuthology.orchestra.run.smithi042.stdout: python-webencodings python-webob python-webtest python-werkzeug 2020-01-26T15:20:02.855 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse python3-cephfs python3-rados python3-rbd python3-rgw 2020-01-26T15:20:02.855 INFO:teuthology.orchestra.run.smithi042.stdout: radosgw rbd-fuse socat xmlstarlet 2020-01-26T15:20:02.855 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages will be upgraded: 2020-01-26T15:20:02.855 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 librbd1 2020-01-26T15:20:02.907 INFO:teuthology.orchestra.run.smithi129.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:20:02.907 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:20:02.907 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:20:02.907 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:20:02.913 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:20:02.931 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:20:02.948 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:20:02.949 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:20:02.953 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:20:02.965 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:20:03.008 INFO:teuthology.orchestra.run.smithi042.stdout:2 upgraded, 74 newly installed, 0 to remove and 53 not upgraded. 2020-01-26T15:20:03.008 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 76.1 MB of archives. 2020-01-26T15:20:03.009 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 304 MB of additional disk space will be used. 2020-01-26T15:20:03.009 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 13.2.8-63-ge1c5fd9-1bionic [1,101 kB] 2020-01-26T15:20:03.051 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:03.055 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:20:03.065 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:20:03.069 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:20:03.316 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:20:03.360 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:20:03.402 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:20:03.403 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:20:03.406 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:20:03.443 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:20:03.485 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 13.2.8-63-ge1c5fd9-1bionic [2,642 kB] 2020-01-26T15:20:03.620 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:03.623 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:20:03.676 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:20:03.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:20:03.823 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:20:03.930 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:20:03.971 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:20:04.165 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:20:04.218 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:20:04.219 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:20:04.262 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:20:04.298 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:20:04.308 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:20:04.312 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:20:04.332 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:20:04.338 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 13.2.8-63-ge1c5fd9-1bionic [393 kB] 2020-01-26T15:20:04.346 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-01-26T15:20:04.358 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:20:04.368 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:20:04.374 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:20:04.384 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:20:04.386 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:20:04.409 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:20:04.410 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:20:04.436 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:20:04.437 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:20:04.439 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:20:04.452 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:20:04.459 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 13.2.8-63-ge1c5fd9-1bionic [293 kB] 2020-01-26T15:20:04.459 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:20:04.464 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:20:04.466 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:20:04.472 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:20:04.478 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:20:04.480 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:20:04.502 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:20:04.524 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.0 kB] 2020-01-26T15:20:04.525 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [95.9 kB] 2020-01-26T15:20:04.525 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:20:04.527 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:20:04.529 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [182 kB] 2020-01-26T15:20:04.537 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:20:04.540 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:20:04.540 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:20:04.544 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:20:04.548 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:20:04.549 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:20:04.550 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:20:04.552 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:20:04.558 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:20:04.590 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 13.2.8-63-ge1c5fd9-1bionic [1,896 kB] 2020-01-26T15:20:04.629 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:20:04.630 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:20:04.632 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:20:04.636 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:20:04.640 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:20:04.777 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-01-26T15:20:04.779 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-01-26T15:20:04.830 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-01-26T15:20:04.883 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2020-01-26T15:20:04.906 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-01-26T15:20:04.922 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-01-26T15:20:04.934 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-01-26T15:20:04.938 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:04.939 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-01-26T15:20:04.941 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 13.2.8-63-ge1c5fd9-1bionic [316 kB] 2020-01-26T15:20:04.966 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:20:04.967 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:20:04.993 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-01-26T15:20:04.995 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-jinja2 all 2.10-1ubuntu0.18.04.1 [94.8 kB] 2020-01-26T15:20:05.007 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-01-26T15:20:05.011 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 13.2.8-63-ge1c5fd9-1bionic [12.1 MB] 2020-01-26T15:20:05.013 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:20:05.018 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:20:05.019 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-01-26T15:20:05.026 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:20:05.027 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-01-26T15:20:05.075 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:20:05.076 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:20:05.098 INFO:teuthology.orchestra.run.smithi042.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-01-26T15:20:05.101 INFO:teuthology.orchestra.run.smithi042.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:20:05.102 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:20:05.105 INFO:teuthology.orchestra.run.smithi042.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-01-26T15:20:05.108 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:20:05.109 INFO:teuthology.orchestra.run.smithi042.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-01-26T15:20:05.216 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:20:05.273 INFO:teuthology.orchestra.run.smithi042.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-01-26T15:20:05.296 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:20:05.296 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:20:05.352 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:20:05.360 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:20:05.363 INFO:teuthology.orchestra.run.smithi204.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:20:05.378 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:20:05.379 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:20:05.423 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:20:05.432 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:20:05.540 INFO:teuthology.orchestra.run.smithi042.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-01-26T15:20:05.541 INFO:teuthology.orchestra.run.smithi042.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-01-26T15:20:05.549 INFO:teuthology.orchestra.run.smithi204.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:20:05.550 INFO:teuthology.orchestra.run.smithi204.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:20:05.555 INFO:teuthology.orchestra.run.smithi204.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:20:05.561 INFO:teuthology.orchestra.run.smithi204.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:20:05.575 INFO:teuthology.orchestra.run.smithi204.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:20:05.579 INFO:teuthology.orchestra.run.smithi204.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:20:05.587 INFO:teuthology.orchestra.run.smithi042.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:20:05.591 INFO:teuthology.orchestra.run.smithi042.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:20:05.600 INFO:teuthology.orchestra.run.smithi204.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:20:05.615 INFO:teuthology.orchestra.run.smithi204.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:20:05.615 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:20:05.616 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:20:05.621 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:20:05.626 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:20:05.635 INFO:teuthology.orchestra.run.smithi204.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:20:05.640 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:20:05.641 INFO:teuthology.orchestra.run.smithi204.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:20:05.644 INFO:teuthology.orchestra.run.smithi129.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:20:05.664 INFO:teuthology.orchestra.run.smithi129.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:20:05.678 INFO:teuthology.orchestra.run.smithi129.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:20:05.691 INFO:teuthology.orchestra.run.smithi129.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:20:05.699 INFO:teuthology.orchestra.run.smithi129.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:20:05.706 INFO:teuthology.orchestra.run.smithi129.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:20:05.711 INFO:teuthology.orchestra.run.smithi204.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:20:05.717 INFO:teuthology.orchestra.run.smithi204.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:20:05.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:20:05.735 INFO:teuthology.orchestra.run.smithi204.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:20:05.738 INFO:teuthology.orchestra.run.smithi204.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:20:05.739 INFO:teuthology.orchestra.run.smithi204.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:20:05.777 INFO:teuthology.orchestra.run.smithi042.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-01-26T15:20:05.777 INFO:teuthology.orchestra.run.smithi129.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:20:05.778 INFO:teuthology.orchestra.run.smithi042.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-01-26T15:20:05.782 INFO:teuthology.orchestra.run.smithi042.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-01-26T15:20:05.784 INFO:teuthology.orchestra.run.smithi129.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:20:05.787 INFO:teuthology.orchestra.run.smithi042.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:20:05.801 INFO:teuthology.orchestra.run.smithi129.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:20:05.803 INFO:teuthology.orchestra.run.smithi042.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-01-26T15:20:05.804 INFO:teuthology.orchestra.run.smithi129.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:20:05.807 INFO:teuthology.orchestra.run.smithi042.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:20:05.808 INFO:teuthology.orchestra.run.smithi129.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:20:05.808 INFO:teuthology.orchestra.run.smithi129.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:20:05.829 INFO:teuthology.orchestra.run.smithi042.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-01-26T15:20:05.841 INFO:teuthology.orchestra.run.smithi042.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-01-26T15:20:05.857 INFO:teuthology.orchestra.run.smithi042.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-01-26T15:20:05.866 INFO:teuthology.orchestra.run.smithi042.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-01-26T15:20:05.903 INFO:teuthology.orchestra.run.smithi204.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:20:05.937 INFO:teuthology.orchestra.run.smithi042.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-01-26T15:20:05.945 INFO:teuthology.orchestra.run.smithi042.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-01-26T15:20:05.956 INFO:teuthology.orchestra.run.smithi042.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-01-26T15:20:05.958 INFO:teuthology.orchestra.run.smithi042.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-01-26T15:20:05.962 INFO:teuthology.orchestra.run.smithi042.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-01-26T15:20:05.962 INFO:teuthology.orchestra.run.smithi042.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-01-26T15:20:05.972 INFO:teuthology.orchestra.run.smithi129.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:20:06.059 INFO:teuthology.orchestra.run.smithi129.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:20:06.126 INFO:teuthology.orchestra.run.smithi042.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-01-26T15:20:06.526 INFO:teuthology.orchestra.run.smithi204.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:20:06.534 INFO:teuthology.orchestra.run.smithi204.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:20:06.534 INFO:teuthology.orchestra.run.smithi204.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:20:06.543 INFO:teuthology.orchestra.run.smithi204.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:20:06.543 INFO:teuthology.orchestra.run.smithi204.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:20:06.544 INFO:teuthology.orchestra.run.smithi204.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:20:06.585 INFO:teuthology.orchestra.run.smithi129.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:20:06.589 INFO:teuthology.orchestra.run.smithi129.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:20:06.592 INFO:teuthology.orchestra.run.smithi129.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:20:06.593 INFO:teuthology.orchestra.run.smithi129.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:20:06.594 INFO:teuthology.orchestra.run.smithi129.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:20:06.598 INFO:teuthology.orchestra.run.smithi129.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:20:06.700 INFO:teuthology.orchestra.run.smithi042.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 13.2.8-63-ge1c5fd9-1bionic [3,687 kB] 2020-01-26T15:20:06.750 INFO:teuthology.orchestra.run.smithi042.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-01-26T15:20:06.755 INFO:teuthology.orchestra.run.smithi042.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-01-26T15:20:06.758 INFO:teuthology.orchestra.run.smithi042.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-01-26T15:20:06.760 INFO:teuthology.orchestra.run.smithi042.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-01-26T15:20:06.760 INFO:teuthology.orchestra.run.smithi042.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-01-26T15:20:06.764 INFO:teuthology.orchestra.run.smithi042.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-01-26T15:20:06.767 INFO:teuthology.orchestra.run.smithi204.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:20:06.767 INFO:teuthology.orchestra.run.smithi204.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:20:06.768 INFO:teuthology.orchestra.run.smithi204.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:20:06.783 INFO:teuthology.orchestra.run.smithi204.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:06.788 INFO:teuthology.orchestra.run.smithi204.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:20:06.806 INFO:teuthology.orchestra.run.smithi204.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:20:06.810 INFO:teuthology.orchestra.run.smithi204.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:20:07.034 INFO:teuthology.orchestra.run.smithi204.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:20:07.122 INFO:teuthology.orchestra.run.smithi042.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 13.2.8-63-ge1c5fd9-1bionic [2,757 kB] 2020-01-26T15:20:07.299 INFO:teuthology.orchestra.run.smithi042.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 13.2.8-63-ge1c5fd9-1bionic [2,965 kB] 2020-01-26T15:20:07.384 INFO:teuthology.orchestra.run.smithi129.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:20:07.384 INFO:teuthology.orchestra.run.smithi129.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:20:07.413 INFO:teuthology.orchestra.run.smithi129.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:20:07.504 INFO:teuthology.orchestra.run.smithi042.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 13.2.8-63-ge1c5fd9-1bionic [13.4 MB] 2020-01-26T15:20:07.518 INFO:teuthology.orchestra.run.smithi129.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:20:07.625 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 76.1 MB in 5s (16.8 MB/s) 2020-01-26T15:20:07.808 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:20:07.858 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:20:07.862 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:20:07.940 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:08.282 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:08.397 INFO:teuthology.orchestra.run.smithi042.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 13.2.8-63-ge1c5fd9-1bionic [3,892 B] 2020-01-26T15:20:08.397 INFO:teuthology.orchestra.run.smithi042.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [465 kB] 2020-01-26T15:20:08.411 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:08.430 INFO:teuthology.orchestra.run.smithi042.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 13.2.8-63-ge1c5fd9-1bionic [1,660 kB] 2020-01-26T15:20:08.539 INFO:teuthology.orchestra.run.smithi042.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 13.2.8-63-ge1c5fd9-1bionic [22.8 MB] 2020-01-26T15:20:08.839 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:08.940 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:09.003 INFO:teuthology.orchestra.run.smithi129.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:20:09.004 INFO:teuthology.orchestra.run.smithi129.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:20:09.005 INFO:teuthology.orchestra.run.smithi129.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:20:09.011 INFO:teuthology.orchestra.run.smithi129.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:09.031 INFO:teuthology.orchestra.run.smithi129.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:20:09.037 INFO:teuthology.orchestra.run.smithi129.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:20:09.040 INFO:teuthology.orchestra.run.smithi129.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:20:09.261 INFO:teuthology.orchestra.run.smithi129.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:20:09.528 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:20:09.543 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:09.586 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:09.677 INFO:teuthology.orchestra.run.smithi042.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 13.2.8-63-ge1c5fd9-1bionic [16.4 kB] 2020-01-26T15:20:09.678 INFO:teuthology.orchestra.run.smithi042.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse amd64 13.2.8-63-ge1c5fd9-1bionic [19.3 kB] 2020-01-26T15:20:09.678 INFO:teuthology.orchestra.run.smithi042.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 13.2.8-63-ge1c5fd9-1bionic [313 kB] 2020-01-26T15:20:09.687 INFO:teuthology.orchestra.run.smithi042.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 13.2.8-63-ge1c5fd9-1bionic [101 kB] 2020-01-26T15:20:09.689 INFO:teuthology.orchestra.run.smithi042.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 13.2.8-63-ge1c5fd9-1bionic [185 kB] 2020-01-26T15:20:09.698 INFO:teuthology.orchestra.run.smithi042.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 13.2.8-63-ge1c5fd9-1bionic [106 kB] 2020-01-26T15:20:09.700 INFO:teuthology.orchestra.run.smithi042.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 13.2.8-63-ge1c5fd9-1bionic [3,287 kB] 2020-01-26T15:20:09.815 INFO:teuthology.orchestra.run.smithi042.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/mimic/e1c5fd9306ce839d8d3ac8160c57aba42e0231a8/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 13.2.8-63-ge1c5fd9-1bionic [13.8 kB] 2020-01-26T15:20:09.853 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 76.1 MB in 6s (11.8 MB/s) 2020-01-26T15:20:09.871 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:20:09.887 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:09.921 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:10.044 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:20:10.091 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:20:10.097 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:20:10.174 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:20:10.182 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:10.185 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:10.216 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:10.412 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 76.1 MB in 7s (11.0 MB/s) 2020-01-26T15:20:10.511 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:10.518 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:20:10.531 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:10.551 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-01-26T15:20:10.600 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137449 files and directories currently installed.) 2020-01-26T15:20:10.604 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../00-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-01-26T15:20:10.610 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:10.639 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:10.675 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:10.938 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:20:10.957 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:20:10.996 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:20:11.010 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../01-librbd1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:11.056 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:11.146 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librbd1 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:11.151 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:11.240 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:20:11.254 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:11.299 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:11.610 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:20:11.625 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:20:11.645 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../02-librados2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:11.677 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:20:11.766 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librados2 (13.2.8-63-ge1c5fd9-1bionic) over (12.2.12-0ubuntu0.18.04.4) ... 2020-01-26T15:20:11.772 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:20:11.785 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:11.855 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.005 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:20:12.018 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:20:12.063 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:20:12.149 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:20:12.164 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:12.199 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.362 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs2. 2020-01-26T15:20:12.377 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../03-libcephfs2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:12.420 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.434 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:20:12.443 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:20:12.447 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:12.457 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:12.484 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:12.493 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.723 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-rados. 2020-01-26T15:20:12.736 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../04-python-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:12.773 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.796 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:20:12.812 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:12.854 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:20:12.864 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:12.868 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:20:12.912 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:13.033 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-ceph-argparse. 2020-01-26T15:20:13.049 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../05-python-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:13.117 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:13.149 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:20:13.161 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:20:13.190 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:20:13.223 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:20:13.239 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:13.281 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:13.369 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-cephfs. 2020-01-26T15:20:13.384 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../06-python-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:13.419 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:13.434 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:20:13.450 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:13.493 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:20:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:13.739 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-prettytable. 2020-01-26T15:20:13.754 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../07-python-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:20:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:13.797 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-01-26T15:20:13.829 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:20:13.845 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:20:13.887 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:20:14.066 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-rbd. 2020-01-26T15:20:14.081 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../08-python-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:14.125 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:14.145 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:20:14.159 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:20:14.182 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:20:14.195 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:20:14.198 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:20:14.232 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:20:14.411 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-certifi. 2020-01-26T15:20:14.424 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../09-python-certifi_2018.1.18-2_all.deb ... 2020-01-26T15:20:14.452 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-01-26T15:20:14.506 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:20:14.521 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:14.544 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:20:14.559 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:14.565 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:14.594 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:14.781 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-chardet. 2020-01-26T15:20:14.795 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../10-python-chardet_3.0.4-1_all.deb ... 2020-01-26T15:20:14.839 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-01-26T15:20:14.897 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:20:14.910 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:20:14.939 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:15.018 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:20:15.033 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:15.076 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-urllib3. 2020-01-26T15:20:15.215 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../11-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:15.225 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:20:15.237 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:15.259 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:15.275 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:15.604 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-requests. 2020-01-26T15:20:15.618 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../12-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-01-26T15:20:15.671 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:15.702 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:20:15.716 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:15.761 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:15.999 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librgw2. 2020-01-26T15:20:16.014 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../13-librgw2_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:16.130 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:20:16.142 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:20:16.180 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:20:16.207 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:16.349 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:20:16.362 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:20:16.407 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:16.441 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:20:16.455 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:16.516 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:16.643 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-rgw. 2020-01-26T15:20:16.658 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../14-python-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:16.701 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:16.718 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:20:16.733 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:20:16.776 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:16.961 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:20:16.974 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:17.028 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:17.104 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liboath0. 2020-01-26T15:20:17.118 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../15-liboath0_2.6.1-1_amd64.deb ... 2020-01-26T15:20:17.162 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-01-26T15:20:17.205 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:20:17.220 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:17.273 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:17.490 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libradosstriper1. 2020-01-26T15:20:17.504 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../16-libradosstriper1_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:17.540 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:18.085 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:20:18.099 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:20:18.144 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:18.218 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-common. 2020-01-26T15:20:18.231 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../17-ceph-common_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:18.268 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:18.472 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:20:18.487 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:20:18.531 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:18.675 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:20:18.689 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:20:18.725 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:18.833 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:20:18.850 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:18.891 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:19.019 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:20:19.034 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:20:19.086 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:19.286 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:20:19.302 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:20:19.345 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:19.516 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-01-26T15:20:19.530 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../18-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-01-26T15:20:19.531 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:20:19.542 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:19.574 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:19.589 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:19.639 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:20:19.655 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:20:19.697 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:20:19.860 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-01-26T15:20:19.876 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../19-libleveldb1v5_1.20-2_amd64.deb ... 2020-01-26T15:20:19.919 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:20.000 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:20:20.014 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:20:20.050 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:20.345 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:20:20.356 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:20:20.380 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-base. 2020-01-26T15:20:20.394 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:20.395 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../20-ceph-base_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:20.425 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:20:20.433 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:20:20.448 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:20.471 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:20.715 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:20:20.727 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:20:20.748 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:20:20.763 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:20:20.764 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:20.806 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:21.026 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:20:21.041 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:21.084 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:21.109 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:20:21.122 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:20:21.159 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:20:21.277 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-cherrypy3. 2020-01-26T15:20:21.291 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../21-python-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:20:21.335 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:21.420 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:20:21.434 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:20:21.487 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:21.529 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:20:21.542 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:20:21.578 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:21.682 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-markupsafe. 2020-01-26T15:20:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../22-python-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:20:21.741 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:21.806 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:20:21.821 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:20:21.865 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:20:21.906 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:20:21.923 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:20:21.965 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:20:22.077 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-jinja2. 2020-01-26T15:20:22.091 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../23-python-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-01-26T15:20:22.135 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:22.167 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:20:22.181 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:20:22.226 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:22.318 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:20:22.332 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:20:22.376 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:20:22.522 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-openssl. 2020-01-26T15:20:22.535 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../24-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:20:22.553 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:20:22.562 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:20:22.580 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:22.604 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:22.712 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:20:22.726 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:20:22.771 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:20:22.848 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:20:22.862 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:20:22.903 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:23.041 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-logutils. 2020-01-26T15:20:23.049 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:20:23.055 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../25-python-logutils_0.3.3-5_all.deb ... 2020-01-26T15:20:23.062 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:23.105 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:23.108 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-01-26T15:20:23.243 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:20:23.257 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:20:23.301 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:20:23.415 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:20:23.427 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-mako. 2020-01-26T15:20:23.429 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:23.442 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../26-python-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:20:23.474 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:23.519 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:23.604 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:20:23.622 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:20:23.662 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:23.796 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:20:23.810 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:20:23.855 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:20:23.864 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-simplegeneric. 2020-01-26T15:20:23.878 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../27-python-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:20:23.922 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:23.973 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:20:23.986 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:20:24.023 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:20:24.163 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:20:24.178 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:20:24.222 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:24.250 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-singledispatch. 2020-01-26T15:20:24.263 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../28-python-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:20:24.308 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:24.351 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:20:24.365 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:20:24.409 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:20:24.590 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:20:24.606 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:20:24.619 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-simplejson. 2020-01-26T15:20:24.634 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../29-python-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:20:24.673 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:24.677 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-01-26T15:20:24.729 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:20:24.745 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:20:24.779 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:20:24.993 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:20:25.007 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:20:25.047 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-webob. 2020-01-26T15:20:25.051 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:25.064 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../30-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:20:25.074 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:20:25.088 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:25.114 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:25.132 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:25.410 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:20:25.425 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:20:25.425 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:20:25.438 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:25.450 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-bs4. 2020-01-26T15:20:25.464 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../31-python-bs4_4.6.0-1_all.deb ... 2020-01-26T15:20:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:20:25.484 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:25.500 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-01-26T15:20:25.814 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:20:25.826 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:20:25.828 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:20:25.842 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:20:25.864 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:20:25.869 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-waitress. 2020-01-26T15:20:25.883 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../32-python-waitress_1.0.1-1_all.deb ... 2020-01-26T15:20:25.889 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:20:25.920 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-01-26T15:20:26.179 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:20:26.193 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:20:26.237 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:26.246 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:20:26.247 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-dnspython. 2020-01-26T15:20:26.260 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../33-python-dnspython_1.15.0-1_all.deb ... 2020-01-26T15:20:26.263 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:20:26.297 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-01-26T15:20:26.304 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:26.590 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:20:26.603 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:20:26.612 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package formencode-i18n. 2020-01-26T15:20:26.620 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:20:26.626 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../34-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:26.636 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:20:26.640 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:26.670 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:26.679 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:26.918 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:20:26.931 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:20:26.968 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:26.978 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-formencode. 2020-01-26T15:20:26.994 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../35-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-01-26T15:20:27.037 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:27.092 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:20:27.106 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:27.150 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:27.290 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:20:27.305 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:20:27.342 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:20:27.409 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-tempita. 2020-01-26T15:20:27.425 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../36-python-tempita_0.5.2-2_all.deb ... 2020-01-26T15:20:27.471 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-01-26T15:20:27.694 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:20:27.708 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:20:27.764 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:20:27.791 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-paste. 2020-01-26T15:20:27.804 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../37-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:20:27.841 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:27.952 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:20:27.968 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:28.010 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:28.144 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:20:28.159 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:20:28.198 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-01-26T15:20:28.202 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:28.211 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-01-26T15:20:28.257 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:28.526 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:20:28.540 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:20:28.584 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:28.585 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pastedeploy. 2020-01-26T15:20:28.599 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../39-python-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:20:28.668 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:20:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:28.747 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:28.984 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:20:28.998 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:29.003 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-webtest. 2020-01-26T15:20:29.019 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../40-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:20:29.042 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:29.062 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:20:29.427 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pecan. 2020-01-26T15:20:29.442 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../41-python-pecan_1.2.1-2_all.deb ... 2020-01-26T15:20:29.489 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-01-26T15:20:29.805 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:20:29.819 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:29.840 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-bcrypt. 2020-01-26T15:20:29.856 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../42-python-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:20:29.863 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:29.900 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:29.952 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph. 2020-01-26T15:20:29.965 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:30.001 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:30.241 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-werkzeug. 2020-01-26T15:20:30.255 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../43-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:20:30.296 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:20:30.300 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:30.309 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:30.346 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:30.550 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:20:30.564 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:30.608 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:30.690 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr. 2020-01-26T15:20:30.705 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../44-ceph-mgr_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:30.750 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:30.800 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:20:30.813 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:30.858 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:31.311 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:20:31.326 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:20:31.361 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:31.493 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mon. 2020-01-26T15:20:31.509 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../45-ceph-mon_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:31.551 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:31.680 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:20:31.695 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:31.738 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:31.921 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph. 2020-01-26T15:20:31.933 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:31.971 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package jq. 2020-01-26T15:20:32.023 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:32.073 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:20:32.291 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:20:32.304 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:32.319 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package socat. 2020-01-26T15:20:32.332 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:20:32.349 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:32.364 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-osd. 2020-01-26T15:20:32.369 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:32.378 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../46-ceph-osd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:32.422 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:32.753 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:20:32.766 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:32.803 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:33.314 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:20:33.328 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:20:33.489 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:20:33.502 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:20:33.539 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:33.819 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:20:33.832 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:20:33.875 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:34.048 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:34.219 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:20:34.219 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph. 2020-01-26T15:20:34.234 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:34.235 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../47-ceph_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:34.269 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:34.285 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:34.393 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:20:34.406 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:34.442 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:34.630 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-fuse. 2020-01-26T15:20:34.643 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../48-ceph-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:34.688 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:34.787 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package jq. 2020-01-26T15:20:34.802 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:34.845 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:20:35.098 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package socat. 2020-01-26T15:20:35.100 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mds. 2020-01-26T15:20:35.113 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:20:35.114 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../49-ceph-mds_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:35.150 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:35.156 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:35.543 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:20:35.557 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:20:35.601 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:35.804 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libonig4:amd64. 2020-01-26T15:20:35.818 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../50-libonig4_6.7.0-1_amd64.deb ... 2020-01-26T15:20:35.862 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:35.871 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:20:35.885 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:20:35.929 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:36.217 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:20:36.230 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:36.232 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjq1:amd64. 2020-01-26T15:20:36.246 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../51-libjq1_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:36.267 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:36.292 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:36.331 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:20:36.344 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:36.382 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:36.527 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:20:36.543 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:20:36.559 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package jq. 2020-01-26T15:20:36.572 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../52-jq_1.5+dfsg-2_amd64.deb ... 2020-01-26T15:20:36.577 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:36.610 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-01-26T15:20:36.838 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:20:36.853 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:20:36.862 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package socat. 2020-01-26T15:20:36.879 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../53-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-01-26T15:20:36.896 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:36.954 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:37.224 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:20:37.238 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:20:37.283 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:20:37.324 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-01-26T15:20:37.340 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../54-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-01-26T15:20:37.382 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:37.586 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:20:37.600 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:20:37.644 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:20:37.680 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package xmlstarlet. 2020-01-26T15:20:37.696 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../55-xmlstarlet_1.6.1-2_amd64.deb ... 2020-01-26T15:20:37.738 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:38.101 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-test. 2020-01-26T15:20:38.117 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../56-ceph-test_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:38.167 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:38.279 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:20:38.293 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:38.329 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:38.330 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:20:38.347 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:20:38.388 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:38.590 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:20:38.603 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:20:38.640 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:38.844 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:20:38.860 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:20:38.909 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:20:38.910 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:20:38.918 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:20:38.976 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:39.281 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:20:39.298 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:20:39.337 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:20:39.339 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:20:39.352 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:20:39.417 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:20:39.676 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:20:39.691 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:20:39.698 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:20:39.713 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:20:39.735 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:39.756 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:20:40.048 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:20:40.061 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:20:40.093 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:20:40.108 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:20:40.121 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:20:40.146 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs-dev. 2020-01-26T15:20:40.151 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:40.163 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../57-libcephfs-dev_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:40.206 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:40.457 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:20:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjs-underscore. 2020-01-26T15:20:40.474 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:20:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../58-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-01-26T15:20:40.524 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:20:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:40.596 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:20:40.612 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:20:40.654 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:20:40.801 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-01-26T15:20:40.815 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../59-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-01-26T15:20:40.835 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:20:40.851 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:40.852 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:20:40.894 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:40.999 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:20:41.013 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:20:41.074 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:20:41.163 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-webencodings. 2020-01-26T15:20:41.178 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../60-python-webencodings_0.5-2_all.deb ... 2020-01-26T15:20:41.205 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:20:41.219 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:41.221 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-webencodings (0.5-2) ... 2020-01-26T15:20:41.263 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:41.428 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:20:41.443 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:20:41.486 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:41.516 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:20:41.532 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:41.532 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-html5lib. 2020-01-26T15:20:41.548 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../61-python-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:20:41.574 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:41.590 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-01-26T15:20:41.822 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:20:41.838 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:20:41.880 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:20:41.919 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-lxml:amd64. 2020-01-26T15:20:41.927 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:20:41.935 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../62-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:20:41.941 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:41.982 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:41.985 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:42.183 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:20:42.197 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:20:42.242 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:20:42.305 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:20:42.320 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:42.363 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:42.431 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-openid. 2020-01-26T15:20:42.446 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../63-python-openid_2.2.5-6_all.deb ... 2020-01-26T15:20:42.481 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-openid (2.2.5-6) ... 2020-01-26T15:20:42.561 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:20:42.576 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:20:42.620 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:42.641 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:20:42.654 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:42.699 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:42.806 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pastescript. 2020-01-26T15:20:42.814 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../64-python-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:20:42.851 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-01-26T15:20:42.948 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:20:42.961 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:43.006 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:43.086 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:20:43.102 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:43.144 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:43.250 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:20:43.264 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:43.308 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:43.321 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pyinotify. 2020-01-26T15:20:43.339 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../65-python-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:20:43.380 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:43.705 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:20:43.711 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:20:43.716 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-repoze.lru. 2020-01-26T15:20:43.719 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:43.725 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:43.730 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../66-python-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:20:43.764 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:43.769 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:43.774 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-01-26T15:20:44.038 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:20:44.052 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:44.055 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:20:44.077 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-routes. 2020-01-26T15:20:44.091 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../67-python-routes_2.4.1-1_all.deb ... 2020-01-26T15:20:44.097 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:44.144 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-routes (2.4.1-1) ... 2020-01-26T15:20:44.311 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:20:44.391 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:20:44.405 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:44.449 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:44.489 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-scgi. 2020-01-26T15:20:44.503 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../68-python-scgi_1.13-1.1build1_amd64.deb ... 2020-01-26T15:20:44.541 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:20:44.547 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:44.756 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:20:44.827 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:20:44.841 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:44.867 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-01-26T15:20:44.883 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../69-python3-ceph-argparse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:44.885 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:44.925 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:44.982 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:20:45.175 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:45.203 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rados. 2020-01-26T15:20:45.218 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../70-python3-rados_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:45.270 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:45.410 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:45.439 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:20:45.452 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:45.488 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:45.603 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:20:45.614 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cephfs. 2020-01-26T15:20:45.628 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../71-python3-cephfs_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:45.664 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:45.763 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:20:45.879 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:45.984 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rbd. 2020-01-26T15:20:45.998 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../72-python3-rbd_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:46.002 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:20:46.014 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:46.050 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:46.220 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:20:46.223 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:46.336 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rgw. 2020-01-26T15:20:46.349 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../73-python3-rgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:46.386 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:46.422 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:20:46.516 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:46.642 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:46.648 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:20:46.776 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:20:46.789 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package radosgw. 2020-01-26T15:20:46.803 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../74-radosgw_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:46.858 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:46.858 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:46.978 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:47.076 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:47.104 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:47.230 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:47.268 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:20:47.426 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package rbd-fuse. 2020-01-26T15:20:47.439 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../75-rbd-fuse_13.2.8-63-ge1c5fd9-1bionic_amd64.deb ... 2020-01-26T15:20:47.465 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:47.484 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:47.536 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:47.590 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:20:47.696 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:47.786 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-01-26T15:20:47.914 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:47.970 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:20:48.049 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-01-26T15:20:48.179 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:48.206 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:48.292 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-01-26T15:20:48.332 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:48.362 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:48.458 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:20:48.621 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:48.651 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:48.743 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-openid (2.2.5-6) ... 2020-01-26T15:20:48.823 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:49.011 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-01-26T15:20:49.015 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:49.019 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:49.142 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:49.145 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:49.204 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2020-01-26T15:20:49.268 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:20:49.396 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:49.422 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-01-26T15:20:49.486 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:49.522 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:20:49.632 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-chardet (3.0.4-1) ... 2020-01-26T15:20:49.704 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:49.830 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:49.866 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:20:49.900 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-01-26T15:20:50.035 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:20:50.042 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:50.056 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:50.252 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:50.291 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:20:50.294 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:50.459 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:50.511 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:50.621 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-01-26T15:20:50.668 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:50.720 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:50.747 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-01-26T15:20:50.820 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:20:50.864 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-01-26T15:20:50.947 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:51.012 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:51.057 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-01-26T15:20:51.072 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:51.138 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:20:51.198 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:20:51.208 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-01-26T15:20:51.343 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:20:51.348 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:51.433 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:51.569 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-ceph-argparse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:51.616 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:51.651 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:51.695 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-waitress (1.0.1-1) ... 2020-01-26T15:20:51.777 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:51.809 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:20:51.987 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:52.026 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:20:52.027 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:20:52.196 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:20:52.220 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:52.224 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-01-26T15:20:52.372 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:52.417 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:20:52.454 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:20:52.581 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:52.591 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:52.685 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-01-26T15:20:52.720 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:20:52.807 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:52.894 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-01-26T15:20:52.909 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:53.035 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:20:53.096 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-01-26T15:20:53.100 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:53.222 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-01-26T15:20:53.228 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:53.234 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:53.361 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:53.373 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-01-26T15:20:53.480 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:53.487 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:53.599 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-01-26T15:20:53.642 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:53.672 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:20:53.764 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:53.826 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-01-26T15:20:53.865 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:20:53.890 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:20:53.943 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:20:54.075 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:54.133 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.195 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-01-26T15:20:54.260 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.318 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:20:54.404 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liboath0 (2.6.1-1) ... 2020-01-26T15:20:54.444 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.444 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:54.549 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.581 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-01-26T15:20:54.678 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:54.807 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-01-26T15:20:54.837 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.933 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-tempita (0.5.2-2) ... 2020-01-26T15:20:54.964 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:54.986 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:55.089 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:55.114 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:55.143 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-01-26T15:20:55.240 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.278 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-webencodings (0.5-2) ... 2020-01-26T15:20:55.290 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.366 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.487 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-01-26T15:20:55.492 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.509 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:20:55.509 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:20:55.618 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.763 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-01-26T15:20:55.767 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:55.769 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:20:55.876 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:20:55.956 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-logutils (0.3.3-5) ... 2020-01-26T15:20:56.020 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.070 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.146 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.166 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-routes (2.4.1-1) ... 2020-01-26T15:20:56.196 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.322 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.364 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.367 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-01-26T15:20:56.490 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.604 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up jq (1.5+dfsg-2) ... 2020-01-26T15:20:56.744 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-01-26T15:20:56.800 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:56.923 INFO:teuthology.orchestra.run.smithi204.stdout:Adding group ceph....done 2020-01-26T15:20:56.926 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:57.055 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:57.126 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:20:57.253 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:57.301 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user ceph....done 2020-01-26T15:20:57.422 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-01-26T15:20:57.468 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:20:57.468 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:20:57.489 INFO:teuthology.orchestra.run.smithi204.stdout:Setting system user ceph properties....done 2020-01-26T15:20:57.548 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-01-26T15:20:57.650 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:20:57.674 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librados2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:57.746 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:57.803 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:57.857 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:20:57.863 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:20:57.952 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs-dev (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.065 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.086 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.116 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.183 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.231 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-01-26T15:20:58.309 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.481 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.506 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:20:58.506 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:20:58.623 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.894 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:58.910 INFO:teuthology.orchestra.run.smithi129.stdout:Adding group ceph....done 2020-01-26T15:20:58.924 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libradosstriper1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.021 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:20:59.026 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.253 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.280 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user ceph....done 2020-01-26T15:20:59.293 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librgw2 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.373 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.444 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.472 INFO:teuthology.orchestra.run.smithi129.stdout:Setting system user ceph properties....done 2020-01-26T15:20:59.499 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.570 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-01-26T15:20:59.629 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:20:59.772 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:20:59.855 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:20:59.938 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:20:59.997 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:20:59.998 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-01-26T15:21:00.169 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:21:00.287 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:21:00.290 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librbd1 (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.316 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:21:00.408 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-01-26T15:21:00.504 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.555 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:21:00.556 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:21:00.601 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.702 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.861 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-common (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:00.940 INFO:teuthology.orchestra.run.smithi204.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:21:00.997 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:01.098 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:21:01.197 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:01.197 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:01.291 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:01.411 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:01.429 INFO:teuthology.orchestra.run.smithi042.stdout:Adding group ceph....done 2020-01-26T15:21:01.450 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:01.537 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:01.794 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:01.794 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:01.816 INFO:teuthology.orchestra.run.smithi042.stdout:Adding system user ceph....done 2020-01-26T15:21:01.974 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:21:02.008 INFO:teuthology.orchestra.run.smithi042.stdout:Setting system user ceph properties....done 2020-01-26T15:21:02.045 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:02.181 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-01-26T15:21:02.278 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:21:02.346 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:21:02.361 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:02.361 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:02.386 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:21:02.423 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-01-26T15:21:02.575 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:02.622 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:02.723 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up radosgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:03.036 INFO:teuthology.orchestra.run.smithi129.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:21:03.120 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:21:03.120 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-01-26T15:21:03.177 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:03.177 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:03.295 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:03.295 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:03.444 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:03.559 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up rbd-fuse (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:03.579 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:03.660 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:21:03.671 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:21:03.864 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:21:03.930 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-test (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:03.934 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:03.934 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:04.064 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rbd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:04.189 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-base (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:04.248 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:04.550 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:04.550 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:04.620 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-01-26T15:21:04.825 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:04.918 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pecan (1.2.1-2) ... 2020-01-26T15:21:04.989 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-01-26T15:21:05.030 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-01-26T15:21:05.227 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-osd (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:05.349 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:21:05.385 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:05.385 INFO:teuthology.orchestra.run.smithi129.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:05.395 INFO:teuthology.orchestra.run.smithi204.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:21:05.450 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:21:05.681 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:05.722 INFO:teuthology.orchestra.run.smithi042.stdout:chown: cannot access '/var/lib/ceph/osd/*/block*': No such file or directory 2020-01-26T15:21:05.783 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:21:05.874 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:21:05.877 DEBUG:teuthology.parallel:result is None 2020-01-26T15:21:05.974 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:21:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:05.983 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-01-26T15:21:06.286 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mds (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:06.610 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:06.611 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-01-26T15:21:06.894 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mon (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:07.213 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:07.213 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-01-26T15:21:07.385 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:21:07.433 INFO:teuthology.orchestra.run.smithi129.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:21:07.486 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:21:07.521 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:07.929 INFO:teuthology.orchestra.run.smithi129.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:21:07.931 DEBUG:teuthology.parallel:result is None 2020-01-26T15:21:08.087 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:08.087 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-01-26T15:21:08.385 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:21:08.503 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:21:08.729 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:21:10.281 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:21:10.327 INFO:teuthology.orchestra.run.smithi042.stdout:ureadahead will be reprofiled on next reboot 2020-01-26T15:21:10.382 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:21:10.862 INFO:teuthology.orchestra.run.smithi042.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:21:10.864 DEBUG:teuthology.parallel:result is None 2020-01-26T15:21:10.865 INFO:teuthology.orchestra.run.smithi204:> sudo lsb_release -is 2020-01-26T15:21:10.918 INFO:teuthology.orchestra.run.smithi204.stdout:Ubuntu 2020-01-26T15:21:10.923 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:21:10.923 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:21:10.923 INFO:teuthology.packaging:ref: None 2020-01-26T15:21:10.924 INFO:teuthology.packaging:tag: None 2020-01-26T15:21:10.924 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:21:10.924 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:21:10.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:21:11.177 INFO:teuthology.orchestra.run.smithi204:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:21:11.206 INFO:teuthology.orchestra.run.smithi204.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.206 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.206 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:21:11.207 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:21:11.264 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:21:11.269 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:21:11.269 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:21:11.270 INFO:teuthology.packaging:ref: None 2020-01-26T15:21:11.270 INFO:teuthology.packaging:tag: None 2020-01-26T15:21:11.270 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:21:11.270 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:21:11.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:21:11.510 INFO:teuthology.orchestra.run.smithi129:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:21:11.536 INFO:teuthology.orchestra.run.smithi129.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.536 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.536 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:21:11.536 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-01-26T15:21:11.589 INFO:teuthology.orchestra.run.smithi042.stdout:Ubuntu 2020-01-26T15:21:11.594 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:21:11.595 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-26T15:21:11.595 INFO:teuthology.packaging:ref: None 2020-01-26T15:21:11.595 INFO:teuthology.packaging:tag: None 2020-01-26T15:21:11.595 INFO:teuthology.packaging:branch: mimic 2020-01-26T15:21:11.595 INFO:teuthology.packaging:sha1: 084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:21:11.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=mimic 2020-01-26T15:21:11.845 INFO:teuthology.orchestra.run.smithi042:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:21:11.870 INFO:teuthology.orchestra.run.smithi042.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.871 INFO:teuthology.packaging:The installed version of ceph is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:21:11.871 INFO:teuthology.task.install:The correct ceph version 13.2.8-63-ge1c5fd9-1bionic is installed. 2020-01-26T15:21:11.871 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-01-26T15:21:11.871 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:21:11.893 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:21:11.914 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-01-26T15:21:11.938 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-01-26T15:21:11.938 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:21:11.956 INFO:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:21:12.014 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:21:12.031 INFO:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:21:12.087 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-01-26T15:21:12.102 INFO:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-01-26T15:21:12.159 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-01-26T15:21:12.160 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:21:12.217 INFO:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:21:12.274 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:21:12.321 INFO:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:21:12.377 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-01-26T15:21:12.423 INFO:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-01-26T15:21:12.485 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:21:12.527 INFO:teuthology.task.print:**** done installing mimic 2020-01-26T15:21:12.528 INFO:teuthology.run_tasks:Running task ceph... 2020-01-26T15:21:12.597 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-01-26T15:21:12.598 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2020-01-26T15:21:12.600 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2020-01-26T15:21:12.603 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2020-01-26T15:21:12.617 INFO:tasks.ceph:Disabling ceph logrotate... 2020-01-26T15:21:12.617 INFO:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:21:12.661 INFO:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:21:12.663 INFO:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2020-01-26T15:21:12.682 INFO:tasks.ceph:Creating extra log directories... 2020-01-26T15:21:12.682 INFO:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:21:12.719 INFO:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:21:12.721 INFO:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-01-26T15:21:12.739 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-01-26T15:21:12.739 INFO:tasks.ceph:config {'mon_bind_addrvec': False, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}}} 2020-01-26T15:21:12.739 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'extra_packages': ['librados2'], 'branch': 'mimic', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm']}}, {'print': '**** done installing mimic'}, {'ceph': {'mon_bind_addrvec': False, 'fs': 'xfs', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'cluster': 'ceph', 'log-whitelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'mon_bind_msgr2': False, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'mon pg warn min per osd': 0, 'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}}, 'max_mds': 1}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client mimic']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done mimic client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None, 'mon.b': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'wait-for-healthy': False, 'mon-health-to-clog': False}}, {'exec': {'mon.a': ['ceph config set global mon_warn_on_msgr2_not_enabled false']}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph mon enable-msgr2', 'ceph versions', 'ceph osd dump -f json-pretty', 'ceph config rm global mon_warn_on_msgr2_not_enabled', 'ceph osd require-osd-release octopus', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.1': {'skip': True}, 'client.0': {'mounted': False}}}, {'ceph-fuse': {'client.1': {'skip': True}, 'client.0': None}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs set cephfs min_compat_client octopus']}}, {'fs.clients_evicted': {'clients': {'client.1': True, 'client.0': False}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2511', 'meta': [{'desc': 'install ceph/mimic latest\n'}], 'owner': 'scheduled_sage@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi129.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSbQQaUcLnqebQ9zlJRWQbpcevsXiSsG2+QhzztF/14I1ZiuA5YNu0lD1qDa3PVJbnCyRWi4eZd3GrytRXh5mFvablVARTFJtLpjSiTNG0Z3DaNWv/h7g6AE8io9MHAtHAhFRQ1RZifkUqx5oL72UlLyQBzem1TZAwQpx1EOcChLRr6LO8DxXLdwpQ3rBlpJlY8X8jUKDvzb4vu/A6/IB8aDpGk07SSSNImGuH71xyPWZumwTmNlK3w8FH6c859yyTsILTcGKovOO7aH8MQ7KkFW6rYQTv6dPS/XJ0nW8Yi54+yT7ROrzZfdOoXjVzbwnOFk45RoM9z6855EFUQ5UH', 'smithi204.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD7le6c62AhWHANvu64I6Dz2nBzVmUkXiPVbEwAw0Dph6cn+HeTiRElLsDUOk0aqnNKeMPj9ztK9NtccoA4RWwI2OUBQi66Xewh0CXNsy+byv2BmcYarFNt5s1U4rFxpE6sZy5B+cdeQtV81wOJSRRXTdBFwqlnd3GClwDAB1/3lRdmCobaRn2/8F33553hDMNOboOD9qglJE9NiV7pXnhN29fqY1GXCPLnF73RQowHb6hDUY4Spzv1Z6W2cH/cvCdoUNitZ3iYrplRUS0CJfGrkW2ZO5nQfnPI0OS0D7hkNGeSuqdr6m55HEKd831LKD3/CovgpdnDdGDtz5YyjRC9', 'smithi042.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpw67UQk/tV4tl6xU12/BrwAZxVV9yVgcoBV8831YKHVGckqgbXkSU7p7g+6pi2vxVT9bLNCJ0KEvIqsLRtptNjwQHB07blXqoVgyqFa5q74Wjrp9lpsZtjvajRHIVNi5nkIUGb6IGfl+bAYm7Y/iTBvk/eQodduyLiBO/WrSFShBhBr4o6/DKHxyiAkD07WKXQ37O46XYMDqDh6aMz1ch0EijKr7mtcRVL8ERfwDNGBHiW3g+9NokLiPb0+L6M6EwW0gRTgebitKl9UZWJG6RSSx0g+v1HCp+rZ7ZVwA1Rg7fnrs7ZiGchcdgq5KMo78+iuqejmFddbRxwwmv92GN'}, 'job_id': '4709314', 'tube': 'smithi', 'suite_branch': 'wip-sage-testing-2020-01-26-0849', 'priority': 70, 'first_in_suite': False, 'branch': 'wip-sage2-testing-2020-01-24-1408', 'suite': 'upgrade:cephfs', 'email': None, 'archive_path': '/home/teuthworker/archive/sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi/4709314', 'description': 'upgrade:cephfs/featureful_client/upgraded_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/no.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-client-upgrade.yaml 4-compat_client.yaml 5-client-sanity.yaml}}', 'nuke-on-error': False, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d', 'name': 'sage-2020-01-26_15:00:33-upgrade:cephfs-wip-sage2-testing-2020-01-24-1408-distro-basic-smithi', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci', 'suite_sha1': 'aa93311c28f80541753eb7d86d811f1316c8e0c7', 'overrides': {'ceph': {'mon_bind_addrvec': False, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'missing required features'], 'mon_bind_msgr2': False, 'max_mds': 1, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'global': {'bluestore warn on no per pool omap': False, 'bluestore warn on legacy statfs': False, 'mon pg warn min per osd': 0}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd op complaint time': 180}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon warn on osd down out interval zero': False, 'mon op complaint time': 120, 'debug ms': 1}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}}, 'fs': 'xfs', 'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'}}, 'admin_socket': {'branch': 'wip-sage2-testing-2020-01-24-1408'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'nuke-on-error': False, 'workunit': {'sha1': 'aa93311c28f80541753eb7d86d811f1316c8e0c7', 'branch': 'wip-sage-testing-2020-01-26-0849'}}} 2020-01-26T15:21:12.741 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:21:12.775 INFO:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:21:12.777 INFO:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-01-26T15:21:12.786 INFO:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:21:12.823 INFO:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:21:12.826 INFO:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2020-01-26T15:21:12.890 DEBUG:teuthology.orchestra.remote:smithi129:/scratch_devs is 72B 2020-01-26T15:21:12.946 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-26T15:21:12.946 INFO:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-01-26T15:21:12.956 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-01-26T15:21:12.956 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:21:12.957 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 452 Links: 1 2020-01-26T15:21:12.957 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:21:12.957 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2020-01-26 15:19:17.138402981 +0000 2020-01-26T15:21:12.957 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2020-01-26 15:19:17.018402984 +0000 2020-01-26T15:21:12.958 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2020-01-26 15:19:17.018402984 +0000 2020-01-26T15:21:12.958 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2020-01-26T15:21:12.965 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2020-01-26T15:21:12.966 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2020-01-26T15:21:12.966 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.00030099 s, 1.7 MB/s 2020-01-26T15:21:12.971 INFO:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-01-26T15:21:13.021 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-01-26T15:21:13.021 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:21:13.021 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 458 Links: 1 2020-01-26T15:21:13.022 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:21:13.022 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2020-01-26 15:19:17.382402976 +0000 2020-01-26T15:21:13.022 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2020-01-26 15:19:17.266402979 +0000 2020-01-26T15:21:13.022 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2020-01-26 15:19:17.266402979 +0000 2020-01-26T15:21:13.022 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2020-01-26T15:21:13.031 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2020-01-26T15:21:13.031 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2020-01-26T15:21:13.031 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000349786 s, 1.5 MB/s 2020-01-26T15:21:13.033 INFO:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-01-26T15:21:13.081 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-01-26T15:21:13.081 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:21:13.081 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 464 Links: 1 2020-01-26T15:21:13.081 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:21:13.082 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2020-01-26 15:19:17.662402970 +0000 2020-01-26T15:21:13.082 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2020-01-26 15:19:17.522402973 +0000 2020-01-26T15:21:13.082 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2020-01-26 15:19:17.522402973 +0000 2020-01-26T15:21:13.082 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2020-01-26T15:21:13.090 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2020-01-26T15:21:13.090 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2020-01-26T15:21:13.090 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.00036261 s, 1.4 MB/s 2020-01-26T15:21:13.095 INFO:teuthology.orchestra.run.smithi129:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-01-26T15:21:13.145 INFO:teuthology.orchestra.run.smithi129.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-01-26T15:21:13.145 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-01-26T15:21:13.145 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 6h/6d Inode: 470 Links: 1 2020-01-26T15:21:13.145 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-01-26T15:21:13.145 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 2020-01-26 15:20:57.538971870 +0000 2020-01-26T15:21:13.146 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2020-01-26 15:19:17.810402966 +0000 2020-01-26T15:21:13.146 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2020-01-26 15:19:17.810402966 +0000 2020-01-26T15:21:13.146 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2020-01-26T15:21:13.154 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records in 2020-01-26T15:21:13.154 INFO:teuthology.orchestra.run.smithi129.stderr:1+0 records out 2020-01-26T15:21:13.155 INFO:teuthology.orchestra.run.smithi129.stderr:512 bytes copied, 0.000380105 s, 1.3 MB/s 2020-01-26T15:21:13.158 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-01-26T15:21:13.159 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-01-26T15:21:13.159 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-01-26T15:21:13.159 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:21:13.159 INFO:tasks.ceph:Generating config... 2020-01-26T15:21:13.162 INFO:tasks.ceph:[mds] mds debug frag = True 2020-01-26T15:21:13.163 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-01-26T15:21:13.163 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] debug mds = 20 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] debug ms = 1 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] mds bal frag = True 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-01-26T15:21:13.164 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-01-26T15:21:13.165 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-01-26T15:21:13.165 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-01-26T15:21:13.165 INFO:tasks.ceph:[client] debug ms = 1 2020-01-26T15:21:13.165 INFO:tasks.ceph:[client] debug client = 20 2020-01-26T15:21:13.165 INFO:tasks.ceph:[client] client mount timeout = 600 2020-01-26T15:21:13.165 INFO:tasks.ceph:[global] mon warn on pool no app = False 2020-01-26T15:21:13.166 INFO:tasks.ceph:[global] ms bind msgr2 = False 2020-01-26T15:21:13.166 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2020-01-26T15:21:13.166 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2020-01-26T15:21:13.166 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2020-01-26T15:21:13.166 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-01-26T15:21:13.166 INFO:tasks.ceph:[osd] debug ms = 1 2020-01-26T15:21:13.166 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-01-26T15:21:13.166 INFO:tasks.ceph:[osd] debug osd = 25 2020-01-26T15:21:13.167 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-01-26T15:21:13.167 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-01-26T15:21:13.167 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-01-26T15:21:13.169 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-01-26T15:21:13.169 INFO:tasks.ceph:[osd] debug journal = 20 2020-01-26T15:21:13.169 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-01-26T15:21:13.169 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-01-26T15:21:13.169 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-01-26T15:21:13.170 INFO:tasks.ceph:[osd] bdev async discard = True 2020-01-26T15:21:13.170 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-01-26T15:21:13.170 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-01-26T15:21:13.170 INFO:tasks.ceph:[osd] debug filestore = 20 2020-01-26T15:21:13.170 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-01-26T15:21:13.171 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-01-26T15:21:13.172 INFO:tasks.ceph:[mon] debug mon = 20 2020-01-26T15:21:13.172 INFO:tasks.ceph:[mon] debug paxos = 20 2020-01-26T15:21:13.172 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2020-01-26T15:21:13.172 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-01-26T15:21:13.173 INFO:tasks.ceph:[mon] debug ms = 1 2020-01-26T15:21:13.173 INFO:tasks.ceph:Setting up mon.a... 2020-01-26T15:21:13.173 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-01-26T15:21:13.282 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.keyring 2020-01-26T15:21:13.285 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-01-26T15:21:13.324 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:21:13.381 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.129:6789'), ('mon.c', '172.21.15.129:6791'), ('mon.b', '172.21.15.129:6790')] 2020-01-26T15:21:13.381 INFO:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --add a 172.21.15.129:6789 --add c 172.21.15.129:6791 --add b 172.21.15.129:6790 --print /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: generated fsid bb47bc39-5bc5-4332-898b-6fff3a2e822b 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:epoch 0 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:fsid bb47bc39-5bc5-4332-898b-6fff3a2e822b 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:last_changed 2020-01-26 15:21:13.452056 2020-01-26T15:21:13.451 INFO:teuthology.orchestra.run.smithi129.stdout:created 2020-01-26 15:21:13.452056 2020-01-26T15:21:13.452 INFO:teuthology.orchestra.run.smithi129.stdout:0: 172.21.15.129:6789/0 mon.a 2020-01-26T15:21:13.452 INFO:teuthology.orchestra.run.smithi129.stdout:1: 172.21.15.129:6790/0 mon.b 2020-01-26T15:21:13.452 INFO:teuthology.orchestra.run.smithi129.stdout:2: 172.21.15.129:6791/0 mon.c 2020-01-26T15:21:13.452 INFO:teuthology.orchestra.run.smithi129.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-01-26T15:21:13.453 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bb47bc39-5bc5-4332-898b-6fff3a2e822b... 2020-01-26T15:21:13.454 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:21:13.457 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:21:13.497 INFO:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-01-26T15:21:13.501 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.502 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2020-01-26T15:21:13.503 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2020-01-26T15:21:13.504 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:21:13.505 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.506 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.129:6789,172.21.15.129:6791,172.21.15.129:6790" 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on pool no app = False 2020-01-26T15:21:13.507 INFO:teuthology.orchestra.run.smithi042.stdout: ms bind msgr2 = False 2020-01-26T15:21:13.508 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn min per osd = 0 2020-01-26T15:21:13.508 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:21:13.508 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:21:13.508 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = bb47bc39-5bc5-4332-898b-6fff3a2e822b 2020-01-26T15:21:13.509 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.509 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2020-01-26T15:21:13.509 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2020-01-26T15:21:13.510 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.511 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:21:13.512 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 25 2020-01-26T15:21:13.513 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 20 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 20 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 10 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: debug journal = 20 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:21:13.514 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: debug filestore = 20 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.515 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2020-01-26T15:21:13.516 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-01-26T15:21:13.516 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2020-01-26T15:21:13.516 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2020-01-26T15:21:13.516 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2020-01-26T15:21:13.517 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.517 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.517 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2020-01-26T15:21:13.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2020-01-26T15:21:13.518 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.519 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:21:13.520 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2020-01-26T15:21:13.521 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split bits = 3 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split size = 100 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2020-01-26T15:21:13.522 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal merge size = 5 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal frag = True 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal fragment size max = 10000 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2020-01-26T15:21:13.523 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2020-01-26T15:21:13.527 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2020-01-26T15:21:13.528 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.529 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:21:13.529 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2020-01-26T15:21:13.529 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2020-01-26T15:21:13.530 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:21:13.531 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2020-01-26T15:21:13.532 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.129:6789,172.21.15.129:6791,172.21.15.129:6790" 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on pool no app = False 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: ms bind msgr2 = False 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn min per osd = 0 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:21:13.533 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = bb47bc39-5bc5-4332-898b-6fff3a2e822b 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2020-01-26T15:21:13.534 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2020-01-26T15:21:13.535 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.536 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2020-01-26T15:21:13.537 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.537 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2020-01-26T15:21:13.537 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.537 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2020-01-26T15:21:13.538 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 25 2020-01-26T15:21:13.542 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 20 2020-01-26T15:21:13.542 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 20 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 10 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: debug journal = 20 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:21:13.543 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: debug filestore = 20 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.544 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.545 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2020-01-26T15:21:13.546 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2020-01-26T15:21:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2020-01-26T15:21:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2020-01-26T15:21:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2020-01-26T15:21:13.547 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: mon op complaint time = 120 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2020-01-26T15:21:13.548 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout: debug client = 20 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout: client mount timeout = 600 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2020-01-26T15:21:13.549 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout:[mds] 2020-01-26T15:21:13.550 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug frag = True 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds bal split bits = 3 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds bal split size = 100 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds = 20 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds bal merge size = 5 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds bal frag = True 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds bal fragment size max = 10000 2020-01-26T15:21:13.551 INFO:teuthology.orchestra.run.smithi129.stdout: mds op complaint time = 180 2020-01-26T15:21:13.552 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug scatterstat = True 2020-01-26T15:21:13.552 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2020-01-26T15:21:13.552 INFO:teuthology.orchestra.run.smithi129.stdout: mds verify scatter = True 2020-01-26T15:21:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2020-01-26T15:21:13.554 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2020-01-26T15:21:13.560 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-01-26T15:21:13.560 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2020-01-26T15:21:13.561 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2020-01-26T15:21:13.562 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.562 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2020-01-26T15:21:13.562 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2020-01-26T15:21:13.562 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.563 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2020-01-26T15:21:13.564 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.565 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.129:6789,172.21.15.129:6791,172.21.15.129:6790" 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on pool no app = False 2020-01-26T15:21:13.566 INFO:teuthology.orchestra.run.smithi204.stdout: ms bind msgr2 = False 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn min per osd = 0 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore warn on no per pool omap = False 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore warn on legacy statfs = False 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = bb47bc39-5bc5-4332-898b-6fff3a2e822b 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2020-01-26T15:21:13.567 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.568 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.569 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2020-01-26T15:21:13.570 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 25 2020-01-26T15:21:13.571 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 20 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 20 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 10 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: debug journal = 20 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2020-01-26T15:21:13.572 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2020-01-26T15:21:13.573 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2020-01-26T15:21:13.573 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2020-01-26T15:21:13.573 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: debug filestore = 20 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2020-01-26T15:21:13.574 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2020-01-26T15:21:13.576 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = False 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2020-01-26T15:21:13.577 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2020-01-26T15:21:13.578 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2020-01-26T15:21:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal split bits = 3 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal split size = 100 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal merge size = 5 2020-01-26T15:21:13.580 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal frag = True 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: mds bal fragment size max = 10000 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2020-01-26T15:21:13.581 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2020-01-26T15:21:13.585 INFO:tasks.ceph:Creating admin key on mon.a... 2020-01-26T15:21:13.585 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-01-26T15:21:13.641 INFO:tasks.ceph:Copying monmap to all nodes... 2020-01-26T15:21:13.691 DEBUG:teuthology.orchestra.remote:smithi129:/etc/ceph/ceph.keyring is 206B 2020-01-26T15:21:13.749 DEBUG:teuthology.orchestra.remote:smithi129:/home/ubuntu/cephtest/ceph.monmap is 357B 2020-01-26T15:21:13.760 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2020-01-26T15:21:13.760 INFO:teuthology.orchestra.run.smithi204:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:21:13.820 INFO:teuthology.orchestra.run.smithi204:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:13.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:13.909 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:21:13.970 INFO:teuthology.orchestra.run.smithi129:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:14.064 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2020-01-26T15:21:14.064 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-01-26T15:21:14.121 INFO:teuthology.orchestra.run.smithi042:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:14.210 INFO:tasks.ceph:Setting up mon nodes... 2020-01-26T15:21:14.211 INFO:tasks.ceph:Setting up mgr nodes... 2020-01-26T15:21:14.211 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-01-26T15:21:14.254 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-01-26T15:21:14.256 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-01-26T15:21:14.340 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-01-26T15:21:14.344 INFO:tasks.ceph:Setting up mds nodes... 2020-01-26T15:21:14.344 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-01-26T15:21:14.429 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-01-26T15:21:14.432 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-01-26T15:21:14.488 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-01-26T15:21:14.572 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-01-26T15:21:14.574 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-01-26T15:21:14.635 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-01-26T15:21:14.720 INFO:teuthology.orchestra.run.smithi129.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-01-26T15:21:14.722 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-01-26T15:21:14.781 INFO:tasks.ceph_client:Setting up client nodes... 2020-01-26T15:21:14.781 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-01-26T15:21:14.876 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-01-26T15:21:14.882 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-01-26T15:21:14.966 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-01-26T15:21:14.980 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-01-26T15:21:14.980 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi129.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-01-26T15:21:14.980 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-01-26T15:21:14.996 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:21:14.996 INFO:tasks.ceph:{} 2020-01-26T15:21:14.996 INFO:tasks.ceph:osd.0 2020-01-26T15:21:14.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:14.997 INFO:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-01-26T15:21:15.522 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:21:15.522 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:21:15.523 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:21:15.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2020-01-26T15:21:15.525 INFO:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-01-26T15:21:15.602 INFO:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-01-26T15:21:15.620 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:21:15.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:21:15.621 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-01-26T15:21:15.677 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:21:15.677 INFO:tasks.ceph:{} 2020-01-26T15:21:15.677 INFO:tasks.ceph:osd.1 2020-01-26T15:21:15.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:15.678 INFO:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-01-26T15:21:16.204 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:21:16.204 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:21:16.204 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:21:16.204 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:21:16.204 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:21:16.205 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:21:16.205 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:21:16.205 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:21:16.205 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:21:16.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2020-01-26T15:21:16.206 INFO:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-01-26T15:21:16.245 INFO:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-01-26T15:21:16.297 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:21:16.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:21:16.299 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-01-26T15:21:16.357 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:21:16.358 INFO:tasks.ceph:{} 2020-01-26T15:21:16.358 INFO:tasks.ceph:osd.2 2020-01-26T15:21:16.358 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:16.358 INFO:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-01-26T15:21:16.868 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:21:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:21:16.868 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:21:16.869 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:21:16.869 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:21:16.869 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:21:16.869 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:21:16.869 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:21:16.870 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:21:16.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2020-01-26T15:21:16.871 INFO:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-01-26T15:21:16.911 INFO:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-01-26T15:21:16.966 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:21:16.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:21:16.968 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-01-26T15:21:17.024 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-01-26T15:21:17.024 INFO:tasks.ceph:{} 2020-01-26T15:21:17.025 INFO:tasks.ceph:osd.3 2020-01-26T15:21:17.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:17.025 INFO:teuthology.orchestra.run.smithi129:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-01-26T15:21:17.554 INFO:teuthology.orchestra.run.smithi129.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-01-26T15:21:17.554 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 attr=2, projid32bit=1 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout: = sunit=0 swidth=0 blks 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-01-26T15:21:17.555 INFO:teuthology.orchestra.run.smithi129.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-01-26T15:21:17.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi129.front.sepia.ceph.com -o noatime 2020-01-26T15:21:17.556 INFO:teuthology.orchestra.run.smithi129:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-01-26T15:21:17.603 INFO:teuthology.orchestra.run.smithi129:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-01-26T15:21:17.658 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: /sbin/restorecon: command not found 2020-01-26T15:21:17.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:21:17.659 INFO:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:17.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.770 7f12c9a91c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-01-26T15:21:17.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.770 7f12c9a91c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-01-26T15:21:17.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.770 7f12c9a91c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:21:17.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.770 7f12c9a91c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:21:17.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.770 7f12c9a91c00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-01-26T15:21:17.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:17.778 7f12c9a91c00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-01-26T15:21:19.943 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-01-26T15:21:19.964 INFO:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:20.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-01-26T15:21:20.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-01-26T15:21:20.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:21:20.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:21:20.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-01-26T15:21:20.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:20.050 7f4695bc6c00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-01-26T15:21:22.222 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-01-26T15:21:22.280 INFO:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:22.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-01-26T15:21:22.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-01-26T15:21:22.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:21:22.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:21:22.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-01-26T15:21:22.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:22.366 7fa6f9765c00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-01-26T15:21:24.540 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-01-26T15:21:24.597 INFO:teuthology.orchestra.run.smithi129:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:24.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-01-26T15:21:24.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-01-26T15:21:24.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:21:24.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:21:24.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-01-26T15:21:24.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:24.682 7f81ed161c00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-01-26T15:21:26.842 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-01-26T15:21:26.897 INFO:tasks.ceph:Reading keys from all nodes... 2020-01-26T15:21:26.897 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:26.944 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.aff0o3Mp5b 2020-01-26T15:21:26.944 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.aff0o3Mp5b 2020-01-26T15:21:27.001 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.aff0o3Mp5b 2020-01-26T15:21:27.110 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.aff0o3Mp5b is 56B 2020-01-26T15:21:27.120 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.aff0o3Mp5b 2020-01-26T15:21:27.126 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:27.182 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.ScX59hK3q9 2020-01-26T15:21:27.182 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.ScX59hK3q9 2020-01-26T15:21:27.237 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.ScX59hK3q9 2020-01-26T15:21:27.342 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.ScX59hK3q9 is 56B 2020-01-26T15:21:27.353 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.ScX59hK3q9 2020-01-26T15:21:27.359 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:27.408 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.AHeqljIwKW 2020-01-26T15:21:27.408 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.AHeqljIwKW 2020-01-26T15:21:27.465 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.AHeqljIwKW 2020-01-26T15:21:27.570 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.AHeqljIwKW is 56B 2020-01-26T15:21:27.584 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.AHeqljIwKW 2020-01-26T15:21:27.590 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:27.640 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.sFcFKr4C1L 2020-01-26T15:21:27.640 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.sFcFKr4C1L 2020-01-26T15:21:27.701 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.sFcFKr4C1L 2020-01-26T15:21:27.806 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.sFcFKr4C1L is 56B 2020-01-26T15:21:27.818 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.sFcFKr4C1L 2020-01-26T15:21:27.824 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:27.872 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.EpDCdM1Ajw 2020-01-26T15:21:27.872 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.EpDCdM1Ajw 2020-01-26T15:21:27.929 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.EpDCdM1Ajw 2020-01-26T15:21:28.046 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.EpDCdM1Ajw is 56B 2020-01-26T15:21:28.107 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.EpDCdM1Ajw 2020-01-26T15:21:28.114 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:28.165 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.t1ZNY7Y6Ck 2020-01-26T15:21:28.165 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.t1ZNY7Y6Ck 2020-01-26T15:21:28.228 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.t1ZNY7Y6Ck 2020-01-26T15:21:28.339 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.t1ZNY7Y6Ck is 56B 2020-01-26T15:21:28.389 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.t1ZNY7Y6Ck 2020-01-26T15:21:28.395 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:28.443 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.ayyouOaOXi 2020-01-26T15:21:28.444 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.ayyouOaOXi 2020-01-26T15:21:28.504 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.ayyouOaOXi 2020-01-26T15:21:28.617 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.ayyouOaOXi is 56B 2020-01-26T15:21:28.629 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.ayyouOaOXi 2020-01-26T15:21:28.635 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:28.684 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.InX3JlbH70 2020-01-26T15:21:28.684 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.InX3JlbH70 2020-01-26T15:21:28.741 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.InX3JlbH70 2020-01-26T15:21:28.846 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.InX3JlbH70 is 56B 2020-01-26T15:21:28.857 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.InX3JlbH70 2020-01-26T15:21:28.863 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:28.912 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.WsRXA1PgsN 2020-01-26T15:21:28.912 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.WsRXA1PgsN 2020-01-26T15:21:28.980 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.WsRXA1PgsN 2020-01-26T15:21:29.086 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.WsRXA1PgsN is 56B 2020-01-26T15:21:29.106 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.WsRXA1PgsN 2020-01-26T15:21:29.123 DEBUG:teuthology.orchestra.remote:smithi204:/etc/ceph/ceph.client.0.keyring is 59B 2020-01-26T15:21:29.142 DEBUG:teuthology.orchestra.remote:smithi042:/etc/ceph/ceph.client.1.keyring is 59B 2020-01-26T15:21:29.154 INFO:tasks.ceph:Adding keys to all mons... 2020-01-26T15:21:29.155 INFO:teuthology.orchestra.run.smithi129:> sudo tee -a /etc/ceph/ceph.keyring 2020-01-26T15:21:29.171 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.x] 2020-01-26T15:21:29.171 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1ezeQyDxAApsADkFK08zA6xJJbeJS3gA== 2020-01-26T15:21:29.171 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr.y] 2020-01-26T15:21:29.171 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1epLljFBAAXjAkeUwx8GMEZtZ6HaW+CA== 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1exg+rGRAAKbrJwP6NlvMAiFcPjXjNig== 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1eF1gnIhAAdvWpZZewaurKu9fwtnl/8w== 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1eAj79KhAA3GGbekrdpSN6GnGjIK6ZGA== 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.0] 2020-01-26T15:21:29.172 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBtri1eezMhLhAAYt9/HrS8UgUp+GmciOOeIw== 2020-01-26T15:21:29.173 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.1] 2020-01-26T15:21:29.173 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBwri1enywlAxAAkkiREIRDfN+Olm5q9ZtGSQ== 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.2] 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQByri1exyALFhAApgV6UNPGI7UqABn/bo42Wg== 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout:[osd.3] 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQB0ri1ecWbgKBAAdS4JE6C/20Tsro9NnpoMyw== 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout:[client.0] 2020-01-26T15:21:29.174 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1eVLnhMxAARdkA7LdJvWCDxDKXJ0K2Nw== 2020-01-26T15:21:29.175 INFO:teuthology.orchestra.run.smithi129.stdout:[client.1] 2020-01-26T15:21:29.175 INFO:teuthology.orchestra.run.smithi129.stdout: key = AQBqri1ezuyZORAAfL+dw5iZyqduqVQmNqPDcg== 2020-01-26T15:21:29.176 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-26T15:21:29.257 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-01-26T15:21:29.338 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.427 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.518 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.603 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.688 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.772 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.856 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-01-26T15:21:29.937 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-26T15:21:30.019 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-01-26T15:21:30.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-01-26T15:21:30.108 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-01-26T15:21:30.165 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:21:30.261 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-01-26T15:21:30.275 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-01-26T15:21:30.332 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:21:30.430 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-01-26T15:21:30.443 INFO:teuthology.orchestra.run.smithi129:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-01-26T15:21:30.499 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-01-26T15:21:30.601 INFO:teuthology.orchestra.run.smithi129:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-01-26T15:21:30.615 INFO:teuthology.orchestra.run.smithi129:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-01-26T15:21:30.664 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-01-26T15:21:30.664 INFO:tasks.ceph.mon.a:Restarting daemon 2020-01-26T15:21:30.665 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-01-26T15:21:30.708 INFO:tasks.ceph.mon.a:Started 2020-01-26T15:21:30.708 INFO:tasks.ceph.mon.b:Restarting daemon 2020-01-26T15:21:30.708 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-01-26T15:21:30.710 INFO:tasks.ceph.mon.b:Started 2020-01-26T15:21:30.710 INFO:tasks.ceph.mon.c:Restarting daemon 2020-01-26T15:21:30.710 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-01-26T15:21:30.712 INFO:tasks.ceph.mon.c:Started 2020-01-26T15:21:30.713 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-01-26T15:21:30.713 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-01-26T15:21:30.713 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-01-26T15:21:30.715 INFO:tasks.ceph.mgr.x:Started 2020-01-26T15:21:30.715 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-01-26T15:21:30.715 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-01-26T15:21:30.718 INFO:tasks.ceph.mgr.y:Started 2020-01-26T15:21:30.718 INFO:tasks.ceph:Setting crush tunables to default 2020-01-26T15:21:30.718 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd crush tunables default 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 Processor -- start 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- - start start 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934014bb30 con 0 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934014bed0 con 0 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933ffff700 1 -- 172.21.15.129:0/2376735835 learned_addr learned my addr 172.21.15.129:0/2376735835 2020-01-26T15:21:30.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9334003630 con 0x7f934014b3f0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3903453304 0 0) 0x7f93340039b0 con 0x7f934014b3f0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f932c002a20 con 0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f93300022a0 con 0x7f93401480f0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3074636421 0 0) 0x7f93300025a0 con 0x7f93401480f0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f932c0046c0 con 0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (421768363 0 0) 0x7f9334003f80 con 0x7f934014b3f0 2020-01-26T15:21:30.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 >> 172.21.15.129:6791/0 conn(0x7f93401480f0 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-01-26T15:21:30.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934007a890 con 0 2020-01-26T15:21:30.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9340116ea0 con 0x7f934014b3f0 2020-01-26T15:21:30.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f933f7fe700 1 -- 172.21.15.129:0/2376735835 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9334001050 con 0x7f934014b3f0 2020-01-26T15:21:30.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- 172.21.15.129:0/2376735835 >> 172.21.15.129:6789/0 conn(0x7f934014b3f0 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- 172.21.15.129:0/2376735835 shutdown_connections 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- 172.21.15.129:0/2376735835 shutdown_connections 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- 172.21.15.129:0/2376735835 wait complete. 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.850 7f9346e36700 1 -- 172.21.15.129:0/2376735835 >> 172.21.15.129:0/2376735835 conn(0x7f9340144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 Processor -- start 2020-01-26T15:21:30.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 -- - start start 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400a3c10 con 0 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400a69e0 con 0 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9344e5c700 1 -- 172.21.15.129:0/2289212820 learned_addr learned my addr 172.21.15.129:0/2289212820 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9334000e50 con 0x7f93400a6230 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (898232898 0 0) 0x7f9334003380 con 0x7f93400a6230 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9320002960 con 0 2020-01-26T15:21:30.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f93300020e0 con 0x7f93400a3250 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1662497929 0 0) 0x7f93300023e0 con 0x7f93400a3250 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9320004620 con 0 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2214154299 0 0) 0x7f93340037d0 con 0x7f93400a6230 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9320002ee0 con 0 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2354932116 0 0) 0x7f9330002650 con 0x7f93400a3250 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9320003540 con 0 2020-01-26T15:21:30.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1224214024 0 0) 0x7f9334001810 con 0x7f93400a6230 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 >> 172.21.15.129:6789/0 conn(0x7f93400a3250 :-1 s=STATE_OPEN pgs=8 cs=1 l=1).mark_down 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934007aaf0 con 0 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93400b2810 con 0 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f9346e36700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f934018b190 con 0 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9334001360 con 0x7f93400a6230 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9334001c40 con 0x7f93400a6230 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 1) v1 ==== 142+0+0 (1513742652 0 0) 0x7f9334004350 con 0x7f93400a6230 2020-01-26T15:21:30.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.854 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 718+0+0 (3594415913 0 0) 0x7f93340049f0 con 0x7f93400a6230 2020-01-26T15:21:30.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.858 7f9346e36700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9340071070 con 0 2020-01-26T15:21:30.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.858 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f9334014db0 con 0x7f93400a6230 2020-01-26T15:21:30.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.930 7f9346e36700 1 -- 172.21.15.129:0/2289212820 --> 172.21.15.129:6790/0 -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f934007ae70 con 0 2020-01-26T15:21:30.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.942 7f933dffb700 1 -- 172.21.15.129:0/2289212820 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (2119647551 0 0) 0x7f934007ae70 con 0x7f93400a6230 2020-01-26T15:21:30.949 INFO:teuthology.orchestra.run.smithi129.stderr:adjusted tunables profile to default 2020-01-26T15:21:30.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.950 7f9346e36700 1 -- 172.21.15.129:0/2289212820 >> 172.21.15.129:6790/0 conn(0x7f93400a6230 :-1 s=STATE_OPEN pgs=9 cs=1 l=1).mark_down 2020-01-26T15:21:30.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.950 7f9346e36700 1 -- 172.21.15.129:0/2289212820 shutdown_connections 2020-01-26T15:21:30.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.950 7f9346e36700 1 -- 172.21.15.129:0/2289212820 shutdown_connections 2020-01-26T15:21:30.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.950 7f9346e36700 1 -- 172.21.15.129:0/2289212820 wait complete. 2020-01-26T15:21:30.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:30.950 7f9346e36700 1 -- 172.21.15.129:0/2289212820 >> 172.21.15.129:0/2289212820 conn(0x7f9340099390 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:30.962 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-01-26T15:21:30.972 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:30.980 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.Vhaw1gAVnH 2020-01-26T15:21:30.981 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.Vhaw1gAVnH 2020-01-26T15:21:31.036 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.Vhaw1gAVnH 2020-01-26T15:21:31.146 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.Vhaw1gAVnH is 37B 2020-01-26T15:21:31.156 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.Vhaw1gAVnH 2020-01-26T15:21:31.161 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:31.208 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.dOQOZn7BUi 2020-01-26T15:21:31.208 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.dOQOZn7BUi 2020-01-26T15:21:31.271 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.dOQOZn7BUi 2020-01-26T15:21:31.388 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.dOQOZn7BUi is 37B 2020-01-26T15:21:31.398 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.dOQOZn7BUi 2020-01-26T15:21:31.405 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:31.452 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.7pJ0Pg3LKJ 2020-01-26T15:21:31.452 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.7pJ0Pg3LKJ 2020-01-26T15:21:31.510 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.7pJ0Pg3LKJ 2020-01-26T15:21:31.614 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.7pJ0Pg3LKJ is 37B 2020-01-26T15:21:31.626 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.7pJ0Pg3LKJ 2020-01-26T15:21:31.632 INFO:teuthology.orchestra.run.smithi129:> mktemp 2020-01-26T15:21:31.680 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.S7zNOeoWDX 2020-01-26T15:21:31.680 INFO:teuthology.orchestra.run.smithi129:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.S7zNOeoWDX 2020-01-26T15:21:31.735 INFO:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.S7zNOeoWDX 2020-01-26T15:21:31.837 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.S7zNOeoWDX is 37B 2020-01-26T15:21:31.886 INFO:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.S7zNOeoWDX 2020-01-26T15:21:31.892 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 862905c0-6fd6-4e29-8d20-a16d92e67224 0 2020-01-26T15:21:32.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 Processor -- start 2020-01-26T15:21:32.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- - start start 2020-01-26T15:21:32.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7814bb30 con 0 2020-01-26T15:21:32.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7814bed0 con 0 2020-01-26T15:21:32.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb77027700 1 -- 172.21.15.129:0/801930293 learned_addr learned my addr 172.21.15.129:0/801930293 2020-01-26T15:21:32.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb680039b0 con 0x7feb781480f0 2020-01-26T15:21:32.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1756437059 0 0) 0x7feb68003d30 con 0x7feb781480f0 2020-01-26T15:21:32.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7feb58002a20 con 0 2020-01-26T15:21:32.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb600022a0 con 0x7feb7814b3f0 2020-01-26T15:21:32.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1039802056 0 0) 0x7feb600025a0 con 0x7feb7814b3f0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7feb580046c0 con 0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2347049013 0 0) 0x7feb60002a40 con 0x7feb7814b3f0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 >> 172.21.15.129:6790/0 conn(0x7feb781480f0 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7807a890 con 0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7feb78116ea0 con 0x7feb7814b3f0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb76025700 1 -- 172.21.15.129:0/801930293 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb60000e50 con 0x7feb7814b3f0 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- 172.21.15.129:0/801930293 >> 172.21.15.129:6789/0 conn(0x7feb7814b3f0 :-1 s=STATE_OPEN pgs=9 cs=1 l=1).mark_down 2020-01-26T15:21:32.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- 172.21.15.129:0/801930293 shutdown_connections 2020-01-26T15:21:32.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- 172.21.15.129:0/801930293 shutdown_connections 2020-01-26T15:21:32.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- 172.21.15.129:0/801930293 wait complete. 2020-01-26T15:21:32.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.034 7feb7d107700 1 -- 172.21.15.129:0/801930293 >> 172.21.15.129:0/801930293 conn(0x7feb78144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb7d107700 1 Processor -- start 2020-01-26T15:21:32.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb7d107700 1 -- - start start 2020-01-26T15:21:32.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb7d107700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780a3c10 con 0 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb7d107700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780a69e0 con 0 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb77027700 1 -- 172.21.15.129:0/4003272830 learned_addr learned my addr 172.21.15.129:0/4003272830 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb60002a40 con 0x7feb780a6230 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3815278607 0 0) 0x7feb60002080 con 0x7feb780a6230 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7feb5c002960 con 0 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb680037c0 con 0x7feb780a3250 2020-01-26T15:21:32.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2468392982 0 0) 0x7feb68003a80 con 0x7feb780a3250 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7feb5c004620 con 0 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3183670084 0 0) 0x7feb68003cf0 con 0x7feb780a3250 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feb5c002ee0 con 0 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2604068293 0 0) 0x7feb60002400 con 0x7feb780a6230 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feb5c003540 con 0 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4213665054 0 0) 0x7feb68001470 con 0x7feb780a3250 2020-01-26T15:21:32.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.038 7feb74822700 1 -- 172.21.15.129:0/4003272830 >> 172.21.15.129:6791/0 conn(0x7feb780a6230 :-1 s=STATE_OPEN pgs=9 cs=1 l=1).mark_down 2020-01-26T15:21:32.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb74822700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7807aaf0 con 0 2020-01-26T15:21:32.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb7d107700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb780b25f0 con 0 2020-01-26T15:21:32.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb7d107700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7818b190 con 0 2020-01-26T15:21:32.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7feb68000f70 con 0x7feb780a3250 2020-01-26T15:21:32.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7feb680018a0 con 0x7feb780a3250 2020-01-26T15:21:32.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (2826370985 0 0) 0x7feb680045e0 con 0x7feb780a3250 2020-01-26T15:21:32.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.042 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 718+0+0 (4068230391 0 0) 0x7feb68005620 con 0x7feb780a3250 2020-01-26T15:21:32.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.046 7feb7d107700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7807ae70 con 0 2020-01-26T15:21:32.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.054 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7feb7807ae70 con 0x7feb780a3250 2020-01-26T15:21:32.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.130 7feb7d107700 1 -- 172.21.15.129:0/4003272830 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd new", "uuid": "862905c0-6fd6-4e29-8d20-a16d92e67224", "id": 0} v 0) v1 -- 0x7feb78073160 con 0 2020-01-26T15:21:32.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.134 7feb74822700 1 -- 172.21.15.129:0/4003272830 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "862905c0-6fd6-4e29-8d20-a16d92e67224", "id": 0}]=0 v3) v1 ==== 112+0+2 (1371877811 0 732707515) 0x7feb680049b0 con 0x7feb780a3250 2020-01-26T15:21:32.138 INFO:teuthology.orchestra.run.smithi129.stdout:0 2020-01-26T15:21:32.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.138 7feb7d107700 1 -- 172.21.15.129:0/4003272830 >> 172.21.15.129:6789/0 conn(0x7feb780a3250 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-01-26T15:21:32.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.138 7feb7d107700 1 -- 172.21.15.129:0/4003272830 shutdown_connections 2020-01-26T15:21:32.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.138 7feb7d107700 1 -- 172.21.15.129:0/4003272830 shutdown_connections 2020-01-26T15:21:32.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.138 7feb7d107700 1 -- 172.21.15.129:0/4003272830 wait complete. 2020-01-26T15:21:32.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.138 7feb7d107700 1 -- 172.21.15.129:0/4003272830 >> 172.21.15.129:0/4003272830 conn(0x7feb78099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.150 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new 5366828c-d7f2-45d2-a018-d90c71b3d22a 1 2020-01-26T15:21:32.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 Processor -- start 2020-01-26T15:21:32.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- - start start 2020-01-26T15:21:32.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00414bb30 con 0 2020-01-26T15:21:32.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00414bed0 con 0 2020-01-26T15:21:32.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00a3b4700 1 -- 172.21.15.129:0/979817216 learned_addr learned my addr 172.21.15.129:0/979817216 2020-01-26T15:21:32.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9ff40022a0 con 0x7fa00414b3f0 2020-01-26T15:21:32.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2903744743 0 0) 0x7f9ff4002620 con 0x7fa00414b3f0 2020-01-26T15:21:32.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9fec002a20 con 0 2020-01-26T15:21:32.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa0000039b0 con 0x7fa0041480f0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3885346506 0 0) 0x7fa000003cb0 con 0x7fa0041480f0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9fec0046c0 con 0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2158375303 0 0) 0x7f9ff4002bf0 con 0x7fa00414b3f0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 >> 172.21.15.129:6791/0 conn(0x7fa0041480f0 :-1 s=STATE_OPEN pgs=10 cs=1 l=1).mark_down 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00407a890 con 0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa004116ea0 con 0x7fa00414b3f0 2020-01-26T15:21:32.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- 172.21.15.129:0/979817216 >> 172.21.15.129:6790/0 conn(0x7fa00414b3f0 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-01-26T15:21:32.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa0093b2700 1 -- 172.21.15.129:0/979817216 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9ff4001050 con 0x7fa00414b3f0 2020-01-26T15:21:32.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- 172.21.15.129:0/979817216 shutdown_connections 2020-01-26T15:21:32.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- 172.21.15.129:0/979817216 shutdown_connections 2020-01-26T15:21:32.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- 172.21.15.129:0/979817216 wait complete. 2020-01-26T15:21:32.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.238 7fa00c38e700 1 -- 172.21.15.129:0/979817216 >> 172.21.15.129:0/979817216 conn(0x7fa004144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 Processor -- start 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 -- - start start 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040a3c10 con 0 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040a69e0 con 0 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00a3b4700 1 -- 172.21.15.129:0/3600706925 learned_addr learned my addr 172.21.15.129:0/3600706925 2020-01-26T15:21:32.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa0000042e0 con 0x7fa0040a3250 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9ff4000e50 con 0x7fa0040a6230 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3820892165 0 0) 0x7f9ff4001ff0 con 0x7fa0040a6230 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9fe4002df0 con 0 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (480217102 0 0) 0x7fa0000037f0 con 0x7fa0040a3250 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9fe4004620 con 0 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1107146268 0 0) 0x7f9ff4002440 con 0x7fa0040a6230 2020-01-26T15:21:32.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9fe4004df0 con 0 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3990776661 0 0) 0x7fa000003d40 con 0x7fa0040a3250 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9fe40034b0 con 0 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (890710240 0 0) 0x7f9ff4001810 con 0x7fa0040a6230 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 >> 172.21.15.129:6790/0 conn(0x7fa0040a3250 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00407aaf0 con 0 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040b2810 con 0 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00418b190 con 0 2020-01-26T15:21:32.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9ff4001360 con 0x7fa0040a6230 2020-01-26T15:21:32.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9ff4002ed0 con 0x7fa0040a6230 2020-01-26T15:21:32.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (2826370985 0 0) 0x7f9ff4003410 con 0x7fa0040a6230 2020-01-26T15:21:32.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.242 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 989+0+0 (2030210517 0 0) 0x7f9ff4004190 con 0x7fa0040a6230 2020-01-26T15:21:32.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.250 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004071070 con 0 2020-01-26T15:21:32.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.254 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f9ff4003920 con 0x7fa0040a6230 2020-01-26T15:21:32.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.330 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5366828c-d7f2-45d2-a018-d90c71b3d22a", "id": 1} v 0) v1 -- 0x7fa00407ae70 con 0 2020-01-26T15:21:32.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.334 7f9ff37fe700 1 -- 172.21.15.129:0/3600706925 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5366828c-d7f2-45d2-a018-d90c71b3d22a", "id": 1}]=0 v4) v1 ==== 112+0+2 (1718760313 0 940483276) 0x7fa00407ae70 con 0x7fa0040a6230 2020-01-26T15:21:32.340 INFO:teuthology.orchestra.run.smithi129.stdout:1 2020-01-26T15:21:32.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.338 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 >> 172.21.15.129:6789/0 conn(0x7fa0040a6230 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-01-26T15:21:32.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.338 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 shutdown_connections 2020-01-26T15:21:32.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.338 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 shutdown_connections 2020-01-26T15:21:32.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.338 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 wait complete. 2020-01-26T15:21:32.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.338 7fa00c38e700 1 -- 172.21.15.129:0/3600706925 >> 172.21.15.129:0/3600706925 conn(0x7fa004099390 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.352 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9 2 2020-01-26T15:21:32.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.434 7f19f4e8a700 1 Processor -- start 2020-01-26T15:21:32.440 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.434 7f19f4e8a700 1 -- - start start 2020-01-26T15:21:32.440 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f014bb30 con 0 2020-01-26T15:21:32.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f014bed0 con 0 2020-01-26T15:21:32.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19eed71700 1 -- 172.21.15.129:0/2519061770 learned_addr learned my addr 172.21.15.129:0/2519061770 2020-01-26T15:21:32.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19e0002620 con 0x7f19f014b3f0 2020-01-26T15:21:32.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19d8003630 con 0x7f19f01480f0 2020-01-26T15:21:32.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4028908958 0 0) 0x7f19e00029a0 con 0x7f19f014b3f0 2020-01-26T15:21:32.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f19d4002ea0 con 0 2020-01-26T15:21:32.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2569391016 0 0) 0x7f19d80039b0 con 0x7f19f01480f0 2020-01-26T15:21:32.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f19d40046b0 con 0 2020-01-26T15:21:32.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (935362538 0 0) 0x7f19e0002e90 con 0x7f19f014b3f0 2020-01-26T15:21:32.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 >> 172.21.15.129:6789/0 conn(0x7f19f01480f0 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-01-26T15:21:32.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f007a890 con 0 2020-01-26T15:21:32.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f19f0116ea0 con 0x7f19f014b3f0 2020-01-26T15:21:32.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19edd6f700 1 -- 172.21.15.129:0/2519061770 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19e0001390 con 0x7f19f014b3f0 2020-01-26T15:21:32.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- 172.21.15.129:0/2519061770 >> 172.21.15.129:6790/0 conn(0x7f19f014b3f0 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-01-26T15:21:32.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- 172.21.15.129:0/2519061770 shutdown_connections 2020-01-26T15:21:32.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- 172.21.15.129:0/2519061770 shutdown_connections 2020-01-26T15:21:32.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- 172.21.15.129:0/2519061770 wait complete. 2020-01-26T15:21:32.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.438 7f19f4e8a700 1 -- 172.21.15.129:0/2519061770 >> 172.21.15.129:0/2519061770 conn(0x7f19f0144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 Processor -- start 2020-01-26T15:21:32.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 -- - start start 2020-01-26T15:21:32.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00a3e10 con 0 2020-01-26T15:21:32.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00a5330 con 0 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19ee570700 1 -- 172.21.15.129:0/1705075098 learned_addr learned my addr 172.21.15.129:0/1705075098 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19d8003ef0 con 0x7f19f0095c60 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19e0001390 con 0x7f19f00a3420 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1359895860 0 0) 0x7f19d8003410 con 0x7f19f0095c60 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f19c8002df0 con 0 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3582694005 0 0) 0x7f19e00023d0 con 0x7f19f00a3420 2020-01-26T15:21:32.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f19c8004620 con 0 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1309095245 0 0) 0x7f19d8003870 con 0x7f19f0095c60 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c8004df0 con 0 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4236609004 0 0) 0x7f19e0002870 con 0x7f19f00a3420 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f19c80034b0 con 0 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1914167787 0 0) 0x7f19d80010f0 con 0x7f19f0095c60 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 >> 172.21.15.129:6789/0 conn(0x7f19f00a3420 :-1 s=STATE_OPEN pgs=13 cs=1 l=1).mark_down 2020-01-26T15:21:32.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f007aaf0 con 0 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00b28d0 con 0 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f19f00ea010 con 0x7f19f0095c60 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f19d8001360 con 0x7f19f0095c60 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00a6c60 con 0 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (2826370985 0 0) 0x7f19d8004260 con 0x7f19f0095c60 2020-01-26T15:21:32.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.442 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1260+0+0 (176536932 0 0) 0x7f19d8004fd0 con 0x7f19f0095c60 2020-01-26T15:21:32.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.450 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f007ae70 con 0 2020-01-26T15:21:32.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.454 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7f19f007ae70 con 0x7f19f0095c60 2020-01-26T15:21:32.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.526 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd new", "uuid": "a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9", "id": 2} v 0) v1 -- 0x7f19f0073160 con 0 2020-01-26T15:21:32.537 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.534 7f19e7fff700 1 -- 172.21.15.129:0/1705075098 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9", "id": 2}]=0 v5) v1 ==== 112+0+2 (3224891573 0 216599125) 0x7f19d8004a90 con 0x7f19f0095c60 2020-01-26T15:21:32.544 INFO:teuthology.orchestra.run.smithi129.stdout:2 2020-01-26T15:21:32.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.542 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 >> 172.21.15.129:6791/0 conn(0x7f19f0095c60 :-1 s=STATE_OPEN pgs=11 cs=1 l=1).mark_down 2020-01-26T15:21:32.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.542 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 shutdown_connections 2020-01-26T15:21:32.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.542 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 shutdown_connections 2020-01-26T15:21:32.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.542 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 wait complete. 2020-01-26T15:21:32.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.542 7f19f4e8a700 1 -- 172.21.15.129:0/1705075098 >> 172.21.15.129:0/1705075098 conn(0x7f19f0099640 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.555 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd new e13a3b22-4e52-4be6-b486-20cdf0ee7cbf 3 2020-01-26T15:21:32.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.642 7ff52906e700 1 Processor -- start 2020-01-26T15:21:32.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.642 7ff52906e700 1 -- - start start 2020-01-26T15:21:32.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52414bb30 con 0 2020-01-26T15:21:32.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52414bed0 con 0 2020-01-26T15:21:32.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522826700 1 -- 172.21.15.129:0/111221733 learned_addr learned my addr 172.21.15.129:0/111221733 2020-01-26T15:21:32.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff518003630 con 0x7ff52414b3f0 2020-01-26T15:21:32.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4195316103 0 0) 0x7ff5180039b0 con 0x7ff52414b3f0 2020-01-26T15:21:32.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff510002a20 con 0 2020-01-26T15:21:32.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff5140022a0 con 0x7ff5241480f0 2020-01-26T15:21:32.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (419473036 0 0) 0x7ff5140025a0 con 0x7ff5241480f0 2020-01-26T15:21:32.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff5100046c0 con 0 2020-01-26T15:21:32.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (428104987 0 0) 0x7ff518003f80 con 0x7ff52414b3f0 2020-01-26T15:21:32.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 >> 172.21.15.129:6791/0 conn(0x7ff5241480f0 :-1 s=STATE_OPEN pgs=12 cs=1 l=1).mark_down 2020-01-26T15:21:32.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52407a890 con 0 2020-01-26T15:21:32.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff524116ea0 con 0x7ff52414b3f0 2020-01-26T15:21:32.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff522025700 1 -- 172.21.15.129:0/111221733 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff518001050 con 0x7ff52414b3f0 2020-01-26T15:21:32.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- 172.21.15.129:0/111221733 >> 172.21.15.129:6790/0 conn(0x7ff52414b3f0 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-01-26T15:21:32.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- 172.21.15.129:0/111221733 shutdown_connections 2020-01-26T15:21:32.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- 172.21.15.129:0/111221733 shutdown_connections 2020-01-26T15:21:32.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- 172.21.15.129:0/111221733 wait complete. 2020-01-26T15:21:32.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.646 7ff52906e700 1 -- 172.21.15.129:0/111221733 >> 172.21.15.129:0/111221733 conn(0x7ff524144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 Processor -- start 2020-01-26T15:21:32.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 -- - start start 2020-01-26T15:21:32.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240a3c10 con 0 2020-01-26T15:21:32.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240a69e0 con 0 2020-01-26T15:21:32.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff523027700 1 -- 172.21.15.129:0/3480058143 learned_addr learned my addr 172.21.15.129:0/3480058143 2020-01-26T15:21:32.688 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff5140020e0 con 0x7ff5240a3250 2020-01-26T15:21:32.688 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (70050840 0 0) 0x7ff5140023e0 con 0x7ff5240a3250 2020-01-26T15:21:32.688 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff504002960 con 0 2020-01-26T15:21:32.688 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff518000e50 con 0x7ff5240a6230 2020-01-26T15:21:32.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3720214886 0 0) 0x7ff518003380 con 0x7ff5240a6230 2020-01-26T15:21:32.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff504004620 con 0 2020-01-26T15:21:32.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (447830910 0 0) 0x7ff514000e50 con 0x7ff5240a3250 2020-01-26T15:21:32.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff504002ee0 con 0 2020-01-26T15:21:32.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1197373078 0 0) 0x7ff518003700 con 0x7ff5240a6230 2020-01-26T15:21:32.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff504003540 con 0 2020-01-26T15:21:32.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2317944644 0 0) 0x7ff5140014e0 con 0x7ff5240a3250 2020-01-26T15:21:32.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 >> 172.21.15.129:6789/0 conn(0x7ff5240a6230 :-1 s=STATE_OPEN pgs=14 cs=1 l=1).mark_down 2020-01-26T15:21:32.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52407aaf0 con 0 2020-01-26T15:21:32.691 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240b2810 con 0 2020-01-26T15:21:32.691 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff52906e700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52418b190 con 0 2020-01-26T15:21:32.691 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff514000bf0 con 0x7ff5240a3250 2020-01-26T15:21:32.691 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff514001910 con 0x7ff5240a3250 2020-01-26T15:21:32.692 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 2) v1 ==== 674+0+0 (2826370985 0 0) 0x7ff514003f90 con 0x7ff5240a3250 2020-01-26T15:21:32.692 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.650 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1531+0+0 (2364096626 0 0) 0x7ff5140050c0 con 0x7ff5240a3250 2020-01-26T15:21:32.692 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.658 7ff52906e700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500002070 con 0 2020-01-26T15:21:32.692 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.662 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+64931 (1092875540 0 2701182919) 0x7ff514004840 con 0x7ff5240a3250 2020-01-26T15:21:32.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.742 7ff52906e700 1 -- 172.21.15.129:0/3480058143 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd new", "uuid": "e13a3b22-4e52-4be6-b486-20cdf0ee7cbf", "id": 3} v 0) v1 -- 0x7ff500001290 con 0 2020-01-26T15:21:32.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.754 7ff520822700 1 -- 172.21.15.129:0/3480058143 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e13a3b22-4e52-4be6-b486-20cdf0ee7cbf", "id": 3}]=0 v6) v1 ==== 112+0+2 (1543687070 0 525046306) 0x7ff514004b30 con 0x7ff5240a3250 2020-01-26T15:21:32.759 INFO:teuthology.orchestra.run.smithi129.stdout:3 2020-01-26T15:21:32.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.758 7ff52906e700 1 -- 172.21.15.129:0/3480058143 >> 172.21.15.129:6790/0 conn(0x7ff5240a3250 :-1 s=STATE_OPEN pgs=16 cs=1 l=1).mark_down 2020-01-26T15:21:32.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.758 7ff52906e700 1 -- 172.21.15.129:0/3480058143 shutdown_connections 2020-01-26T15:21:32.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.758 7ff52906e700 1 -- 172.21.15.129:0/3480058143 shutdown_connections 2020-01-26T15:21:32.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.758 7ff52906e700 1 -- 172.21.15.129:0/3480058143 wait complete. 2020-01-26T15:21:32.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:32.758 7ff52906e700 1 -- 172.21.15.129:0/3480058143 >> 172.21.15.129:0/3480058143 conn(0x7ff524099390 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:32.774 INFO:tasks.ceph.osd.0:Restarting daemon 2020-01-26T15:21:32.774 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-01-26T15:21:32.779 INFO:tasks.ceph.osd.0:Started 2020-01-26T15:21:32.780 INFO:tasks.ceph.osd.1:Restarting daemon 2020-01-26T15:21:32.780 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-01-26T15:21:32.788 INFO:tasks.ceph.osd.1:Started 2020-01-26T15:21:32.788 INFO:tasks.ceph.osd.2:Restarting daemon 2020-01-26T15:21:32.788 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-01-26T15:21:32.791 INFO:tasks.ceph.osd.2:Started 2020-01-26T15:21:32.791 INFO:tasks.ceph.osd.3:Restarting daemon 2020-01-26T15:21:32.792 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-01-26T15:21:32.794 INFO:tasks.ceph.osd.3:Started 2020-01-26T15:21:32.794 INFO:tasks.ceph:Waiting for OSDs to come up 2020-01-26T15:21:32.856 INFO:tasks.ceph.osd.1.smithi129.stdout:starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal 2020-01-26T15:21:32.859 INFO:tasks.ceph.osd.3.smithi129.stdout:starting osd.3 at - osd_data /var/lib/ceph/osd/ceph-3 /var/lib/ceph/osd/ceph-3/journal 2020-01-26T15:21:32.862 INFO:tasks.ceph.osd.0.smithi129.stdout:starting osd.0 at - osd_data /var/lib/ceph/osd/ceph-0 /var/lib/ceph/osd/ceph-0/journal 2020-01-26T15:21:32.870 INFO:tasks.ceph.osd.2.smithi129.stdout:starting osd.2 at - osd_data /var/lib/ceph/osd/ceph-2 /var/lib/ceph/osd/ceph-2/journal 2020-01-26T15:21:33.200 INFO:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:33.270 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.266 7fefbc90f700 1 Processor -- start 2020-01-26T15:21:33.270 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.266 7fefbc90f700 1 -- - start start 2020-01-26T15:21:33.272 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.266 7fefbc90f700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb814bb10 con 0 2020-01-26T15:21:33.272 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.266 7fefbc90f700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb814beb0 con 0 2020-01-26T15:21:33.272 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb6025700 1 -- 172.21.15.129:0/405883555 learned_addr learned my addr 172.21.15.129:0/405883555 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa80022a0 con 0x7fefb81480d0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3554656026 0 0) 0x7fefa8002620 con 0x7fefb81480d0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fef98002a20 con 0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa0003630 con 0x7fefb814b3d0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3582501286 0 0) 0x7fefa00039b0 con 0x7fefb814b3d0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fef980046c0 con 0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3364134445 0 0) 0x7fefa0003e60 con 0x7fefb814b3d0 2020-01-26T15:21:33.273 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 >> 172.21.15.129:6791/0 conn(0x7fefb81480d0 :-1 s=STATE_OPEN pgs=15 cs=1 l=1).mark_down 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb807a930 con 0 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fefb8116e80 con 0x7fefb814b3d0 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb5824700 1 -- 172.21.15.129:0/405883555 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa0001010 con 0x7fefb814b3d0 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- 172.21.15.129:0/405883555 >> 172.21.15.129:6790/0 conn(0x7fefb814b3d0 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- 172.21.15.129:0/405883555 shutdown_connections 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- 172.21.15.129:0/405883555 shutdown_connections 2020-01-26T15:21:33.274 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- 172.21.15.129:0/405883555 wait complete. 2020-01-26T15:21:33.275 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- 172.21.15.129:0/405883555 >> 172.21.15.129:0/405883555 conn(0x7fefb8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:33.278 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 Processor -- start 2020-01-26T15:21:33.278 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- - start start 2020-01-26T15:21:33.278 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80a3dc0 con 0 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefbc90f700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80a69a0 con 0 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefb6826700 1 -- 172.21.15.129:0/1178952612 learned_addr learned my addr 172.21.15.129:0/1178952612 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa80020e0 con 0x7fefb80a33d0 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (32758616 0 0) 0x7fefa8002360 con 0x7fefb80a33d0 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fef9c002960 con 0 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa00038d0 con 0x7fefb80a6350 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1930438914 0 0) 0x7fefa0000e50 con 0x7fefb80a6350 2020-01-26T15:21:33.279 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.270 7fefaffff700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fef9c004620 con 0 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1894639262 0 0) 0x7fefa0003410 con 0x7fefb80a6350 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef9c002ee0 con 0 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2693080039 0 0) 0x7fefa8000e50 con 0x7fefb80a33d0 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fef9c003540 con 0 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (988866460 0 0) 0x7fefa00017d0 con 0x7fefb80a6350 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 >> 172.21.15.129:6790/0 conn(0x7fefb80a33d0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:21:33.280 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb807ab90 con 0 2020-01-26T15:21:33.281 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb80b27b0 con 0 2020-01-26T15:21:33.281 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb818b200 con 0 2020-01-26T15:21:33.281 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fefa0000bf0 con 0x7fefb80a6350 2020-01-26T15:21:33.282 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fefa0001a40 con 0x7fefb80a6350 2020-01-26T15:21:33.282 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fefa00046f0 con 0x7fefb80a6350 2020-01-26T15:21:33.282 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.274 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1802+0+0 (2155613106 0 0) 0x7fefa0005af0 con 0x7fefb80a6350 2020-01-26T15:21:33.285 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.282 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef90002070 con 0 2020-01-26T15:21:33.290 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.286 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fefa00041d0 con 0x7fefb80a6350 2020-01-26T15:21:33.377 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.374 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef900011f0 con 0 2020-01-26T15:21:33.377 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.374 7fefaffff700 1 -- 172.21.15.129:0/1178952612 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+2575 (3955300355 0 2304148705) 0x7fefa0004f50 con 0x7fefb80a6350 2020-01-26T15:21:33.377 INFO:teuthology.misc.health.smithi129.stdout: 2020-01-26T15:21:33.378 INFO:teuthology.misc.health.smithi129.stdout:{"epoch":6,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:32.746495","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":0,"in":0,"weight":0.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"-","cluster_addr":"-","heartbeat_back_addr":"-","heartbeat_front_addr":"-","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:33.379 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 >> 172.21.15.129:6800/11038 conn(0x7fef9c006ed0 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:21:33.379 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 >> 172.21.15.129:6789/0 conn(0x7fefb80a6350 :-1 s=STATE_OPEN pgs=18 cs=1 l=1).mark_down 2020-01-26T15:21:33.379 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 shutdown_connections 2020-01-26T15:21:33.379 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 shutdown_connections 2020-01-26T15:21:33.379 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 wait complete. 2020-01-26T15:21:33.380 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:33.378 7fefbc90f700 1 -- 172.21.15.129:0/1178952612 >> 172.21.15.129:0/1178952612 conn(0x7fefb8099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:33.387 DEBUG:teuthology.misc:0 of 4 OSDs are up 2020-01-26T15:21:33.465 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26 15:21:33.462 7fd7f7965c00 -1 osd.1 0 log_to_monitors {default=true} 2020-01-26T15:21:33.480 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26 15:21:33.478 7fea97cb7c00 -1 osd.0 0 log_to_monitors {default=true} 2020-01-26T15:21:33.706 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26 15:21:33.702 7f6396084c00 -1 osd.3 0 log_to_monitors {default=true} 2020-01-26T15:21:33.748 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26 15:21:33.746 7f3cd34f8c00 -1 osd.2 0 log_to_monitors {default=true} 2020-01-26T15:21:34.860 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26 15:21:34.858 7f6370472700 -1 osd.3 0 waiting for initial osdmap 2020-01-26T15:21:34.861 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26 15:21:34.858 7fea720a5700 -1 osd.0 0 waiting for initial osdmap 2020-01-26T15:21:34.862 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26 15:21:34.858 7fd7d1d53700 -1 osd.1 0 waiting for initial osdmap 2020-01-26T15:21:34.862 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26 15:21:34.858 7f3cad8e6700 -1 osd.2 0 waiting for initial osdmap 2020-01-26T15:21:39.789 INFO:teuthology.orchestra.run.smithi129:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:39.887 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 Processor -- start 2020-01-26T15:21:39.887 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 -- - start start 2020-01-26T15:21:39.888 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3014bb10 con 0 2020-01-26T15:21:39.888 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3014beb0 con 0 2020-01-26T15:21:39.888 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2effd700 1 -- 172.21.15.129:0/1914386880 learned_addr learned my addr 172.21.15.129:0/1914386880 2020-01-26T15:21:39.889 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd20002620 con 0x7efd301480d0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3954481918 0 0) 0x7efd200029a0 con 0x7efd301480d0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efd10002a20 con 0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd18003630 con 0x7efd3014b3d0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3152785389 0 0) 0x7efd18003930 con 0x7efd3014b3d0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efd100046c0 con 0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3445597351 0 0) 0x7efd20002f70 con 0x7efd301480d0 2020-01-26T15:21:39.890 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 >> 172.21.15.129:6791/0 conn(0x7efd3014b3d0 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-01-26T15:21:39.891 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3007a930 con 0 2020-01-26T15:21:39.891 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7efd300e9ff0 con 0x7efd301480d0 2020-01-26T15:21:39.891 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd2e7fc700 1 -- 172.21.15.129:0/1914386880 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd200013d0 con 0x7efd301480d0 2020-01-26T15:21:39.891 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 -- 172.21.15.129:0/1914386880 >> 172.21.15.129:6789/0 conn(0x7efd301480d0 :-1 s=STATE_OPEN pgs=19 cs=1 l=1).mark_down 2020-01-26T15:21:39.892 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.886 7efd358e2700 1 -- 172.21.15.129:0/1914386880 shutdown_connections 2020-01-26T15:21:39.892 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- 172.21.15.129:0/1914386880 shutdown_connections 2020-01-26T15:21:39.892 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- 172.21.15.129:0/1914386880 wait complete. 2020-01-26T15:21:39.892 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- 172.21.15.129:0/1914386880 >> 172.21.15.129:0/1914386880 conn(0x7efd30144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:39.893 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 Processor -- start 2020-01-26T15:21:39.893 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- - start start 2020-01-26T15:21:39.893 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300a3d30 con 0 2020-01-26T15:21:39.893 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd358e2700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300a51e0 con 0 2020-01-26T15:21:39.893 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2f7fe700 1 -- 172.21.15.129:0/2150765972 learned_addr learned my addr 172.21.15.129:0/2150765972 2020-01-26T15:21:39.897 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd18003e70 con 0x7efd30095c70 2020-01-26T15:21:39.897 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4150248879 0 0) 0x7efd18003440 con 0x7efd30095c70 2020-01-26T15:21:39.897 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efd14002960 con 0 2020-01-26T15:21:39.897 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd20001390 con 0x7efd300a3430 2020-01-26T15:21:39.897 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (227142720 0 0) 0x7efd200023f0 con 0x7efd300a3430 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7efd14004620 con 0 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3806580352 0 0) 0x7efd18003960 con 0x7efd30095c70 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.890 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd14004fa0 con 0 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1113761574 0 0) 0x7efd20002850 con 0x7efd300a3430 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd140076a0 con 0 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (154729355 0 0) 0x7efd20001b90 con 0x7efd300a3430 2020-01-26T15:21:39.898 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 >> 172.21.15.129:6791/0 conn(0x7efd30095c70 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3007ab90 con 0 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd358e2700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300b27b0 con 0 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd358e2700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300a6c70 con 0 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7efd20000f70 con 0x7efd300a3430 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7efd20001fc0 con 0x7efd300a3430 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7efd20003710 con 0x7efd300a3430 2020-01-26T15:21:39.899 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.894 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (1614944077 0 0) 0x7efd20005f50 con 0x7efd300a3430 2020-01-26T15:21:39.901 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.898 7efd358e2700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08002070 con 0 2020-01-26T15:21:39.905 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.902 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7efd200031f0 con 0x7efd300a3430 2020-01-26T15:21:39.997 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.994 7efd358e2700 1 -- 172.21.15.129:0/2150765972 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd08001220 con 0 2020-01-26T15:21:39.998 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.994 7efd2cff9700 1 -- 172.21.15.129:0/2150765972 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+3011 (4128480379 0 2851718609) 0x7efd200034d0 con 0x7efd300a3430 2020-01-26T15:21:39.998 INFO:teuthology.misc.health.smithi129.stdout: 2020-01-26T15:21:39.998 INFO:teuthology.misc.health.smithi129.stdout:{"epoch":9,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:35.858831","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 >> 172.21.15.129:6800/11038 conn(0x7efd14005ff0 :-1 s=STATE_OPEN pgs=19 cs=1 l=1).mark_down 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 >> 172.21.15.129:6789/0 conn(0x7efd300a3430 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 shutdown_connections 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 shutdown_connections 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 wait complete. 2020-01-26T15:21:40.000 INFO:teuthology.misc.health.smithi129.stderr:2020-01-26 15:21:39.998 7efd358e2700 1 -- 172.21.15.129:0/2150765972 >> 172.21.15.129:0/2150765972 conn(0x7efd30099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:40.009 DEBUG:teuthology.misc:4 of 4 OSDs are up 2020-01-26T15:21:40.009 INFO:tasks.ceph:Creating RBD pool 2020-01-26T15:21:40.009 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd pool create rbd 8 2020-01-26T15:21:40.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 Processor -- start 2020-01-26T15:21:40.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- - start start 2020-01-26T15:21:40.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3014bb50 con 0 2020-01-26T15:21:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3014bef0 con 0 2020-01-26T15:21:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2f7fe700 1 -- 172.21.15.129:0/900398142 learned_addr learned my addr 172.21.15.129:0/900398142 2020-01-26T15:21:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e240022a0 con 0x7f0e3014b410 2020-01-26T15:21:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e20003630 con 0x7f0e30148110 2020-01-26T15:21:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3659144923 0 0) 0x7f0e24002620 con 0x7f0e3014b410 2020-01-26T15:21:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e1c002ea0 con 0 2020-01-26T15:21:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (338620860 0 0) 0x7f0e200039b0 con 0x7f0e30148110 2020-01-26T15:21:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e1c0046b0 con 0 2020-01-26T15:21:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3738664198 0 0) 0x7f0e20003e50 con 0x7f0e30148110 2020-01-26T15:21:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 >> 172.21.15.129:6790/0 conn(0x7f0e3014b410 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:21:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3007a8b0 con 0 2020-01-26T15:21:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e300ea030 con 0x7f0e30148110 2020-01-26T15:21:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- 172.21.15.129:0/900398142 >> 172.21.15.129:6791/0 conn(0x7f0e30148110 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:21:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e2e7fc700 1 -- 172.21.15.129:0/900398142 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e20001010 con 0x7f0e30148110 2020-01-26T15:21:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- 172.21.15.129:0/900398142 shutdown_connections 2020-01-26T15:21:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- 172.21.15.129:0/900398142 shutdown_connections 2020-01-26T15:21:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- 172.21.15.129:0/900398142 wait complete. 2020-01-26T15:21:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.098 7f0e35817700 1 -- 172.21.15.129:0/900398142 >> 172.21.15.129:0/900398142 conn(0x7f0e30144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:40.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 Processor -- start 2020-01-26T15:21:40.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 -- - start start 2020-01-26T15:21:40.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300a3c90 con 0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300a6a60 con 0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2f7fe700 1 -- 172.21.15.129:0/3984955369 learned_addr learned my addr 172.21.15.129:0/3984955369 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e20000e50 con 0x7f0e300a32a0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4206365822 0 0) 0x7f0e20003440 con 0x7f0e300a32a0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e10002960 con 0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e24002bb0 con 0x7f0e300a62b0 2020-01-26T15:21:40.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1018879767 0 0) 0x7f0e24001ff0 con 0x7f0e300a62b0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e10004620 con 0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4205150245 0 0) 0x7f0e20003890 con 0x7f0e300a32a0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e10002ee0 con 0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3855084858 0 0) 0x7f0e24002490 con 0x7f0e300a62b0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0e10003540 con 0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2146746930 0 0) 0x7f0e200017d0 con 0x7f0e300a32a0 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 >> 172.21.15.129:6789/0 conn(0x7f0e300a62b0 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:21:40.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3007ab10 con 0 2020-01-26T15:21:40.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e300b2900 con 0 2020-01-26T15:21:40.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e35817700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3018b200 con 0 2020-01-26T15:21:40.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e20000bf0 con 0x7f0e300a32a0 2020-01-26T15:21:40.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e20001c00 con 0x7f0e300a32a0 2020-01-26T15:21:40.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f0e20004780 con 0x7f0e300a32a0 2020-01-26T15:21:40.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.102 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1938+0+0 (1614944077 0 0) 0x7f0e20005ee0 con 0x7f0e300a32a0 2020-01-26T15:21:40.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.110 7f0e35817700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0c002070 con 0 2020-01-26T15:21:40.117 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.114 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0e20004260 con 0x7f0e300a32a0 2020-01-26T15:21:40.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.214 7f0e35817700 1 -- 172.21.15.129:0/3984955369 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7f0e0c001250 con 0 2020-01-26T15:21:40.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.902 7f0e2cff9700 1 -- 172.21.15.129:0/3984955369 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (1706632610 0 0) 0x7f0e200052b0 con 0x7f0e300a32a0 2020-01-26T15:21:40.929 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'rbd' created 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 >> 172.21.15.129:6800/11038 conn(0x7f0e10006f20 :-1 s=STATE_OPEN pgs=20 cs=1 l=1).mark_down 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 >> 172.21.15.129:6790/0 conn(0x7f0e300a32a0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 shutdown_connections 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 shutdown_connections 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 wait complete. 2020-01-26T15:21:40.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:40.930 7f0e35817700 1 -- 172.21.15.129:0/3984955369 >> 172.21.15.129:0/3984955369 conn(0x7f0e30099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:40.944 INFO:teuthology.orchestra.run.smithi129:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-01-26T15:21:41.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0e32a3700 1 Processor -- start 2020-01-26T15:21:41.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0e32a3700 1 -- - start start 2020-01-26T15:21:41.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0e32a3700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc14bb40 con 0 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0e32a3700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc14bee0 con 0 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0e12c9700 1 -- 172.21.15.129:0/3874335961 learned_addr learned my addr 172.21.15.129:0/3874335961 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0d8003630 con 0x7fe0dc148100 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2976747793 0 0) 0x7fe0d80039b0 con 0x7fe0dc148100 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe0c0002a20 con 0 2020-01-26T15:21:41.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0cc0022a0 con 0x7fe0dc14b400 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4117009952 0 0) 0x7fe0cc0025a0 con 0x7fe0dc14b400 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.046 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe0c00046c0 con 0 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1339732710 0 0) 0x7fe0d8003f80 con 0x7fe0dc148100 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 >> 172.21.15.129:6789/0 conn(0x7fe0dc14b400 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc07a960 con 0 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe0dc0ea020 con 0x7fe0dc148100 2020-01-26T15:21:41.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0d3fff700 1 -- 172.21.15.129:0/3874335961 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0d8001050 con 0x7fe0dc148100 2020-01-26T15:21:41.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0e32a3700 1 -- 172.21.15.129:0/3874335961 >> 172.21.15.129:6790/0 conn(0x7fe0dc148100 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:21:41.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0e32a3700 1 -- 172.21.15.129:0/3874335961 shutdown_connections 2020-01-26T15:21:41.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0e32a3700 1 -- 172.21.15.129:0/3874335961 shutdown_connections 2020-01-26T15:21:41.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0e32a3700 1 -- 172.21.15.129:0/3874335961 wait complete. 2020-01-26T15:21:41.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.050 7fe0e32a3700 1 -- 172.21.15.129:0/3874335961 >> 172.21.15.129:0/3874335961 conn(0x7fe0dc144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:41.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 Processor -- start 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 -- - start start 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0a3e10 con 0 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0a6be0 con 0 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e12c9700 1 -- 172.21.15.129:0/1699840999 learned_addr learned my addr 172.21.15.129:0/1699840999 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0d8000e50 con 0x7fe0dc0a3420 2020-01-26T15:21:41.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2600153291 0 0) 0x7fe0d8003380 con 0x7fe0dc0a3420 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe0c4002960 con 0 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0cc002ae0 con 0x7fe0dc0a6430 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (654976916 0 0) 0x7fe0cc0020e0 con 0x7fe0dc0a6430 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe0c4004620 con 0 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1372659368 0 0) 0x7fe0d80037d0 con 0x7fe0dc0a3420 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0c4002ee0 con 0 2020-01-26T15:21:41.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1084668006 0 0) 0x7fe0cc002350 con 0x7fe0dc0a6430 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe0c4003540 con 0 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1764967828 0 0) 0x7fe0d8001810 con 0x7fe0dc0a3420 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 >> 172.21.15.129:6791/0 conn(0x7fe0dc0a6430 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc07abc0 con 0 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc0b2970 con 0 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc18b230 con 0 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe0d8000bf0 con 0x7fe0dc0a3420 2020-01-26T15:21:41.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe0d8001c40 con 0x7fe0dc0a3420 2020-01-26T15:21:41.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fe0d8004780 con 0x7fe0dc0a3420 2020-01-26T15:21:41.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.054 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 2196+0+0 (2027043579 0 0) 0x7fe0d8005ef0 con 0x7fe0dc0a3420 2020-01-26T15:21:41.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.062 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b8002070 con 0 2020-01-26T15:21:41.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.066 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe0d8004260 con 0x7fe0dc0a3420 2020-01-26T15:21:41.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.158 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"} v 0) v1 -- 0x7fe0b8001300 con 0 2020-01-26T15:21:41.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.914 7fe0d27fc700 1 -- 172.21.15.129:0/1699840999 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "force": "--yes-i-really-mean-it", "app": "rbd", "pool": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 178+0+0 (3289075488 0 0) 0x7fe0d80051c0 con 0x7fe0dc0a3420 2020-01-26T15:21:41.924 INFO:teuthology.orchestra.run.smithi129.stderr:enabled application 'rbd' on pool 'rbd' 2020-01-26T15:21:41.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 >> 172.21.15.129:6800/11038 conn(0x7fe0c4006180 :-1 s=STATE_OPEN pgs=21 cs=1 l=1).mark_down 2020-01-26T15:21:41.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 >> 172.21.15.129:6789/0 conn(0x7fe0dc0a3420 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:21:41.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 shutdown_connections 2020-01-26T15:21:41.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 shutdown_connections 2020-01-26T15:21:41.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 wait complete. 2020-01-26T15:21:41.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:41.926 7fe0e32a3700 1 -- 172.21.15.129:0/1699840999 >> 172.21.15.129:0/1699840999 conn(0x7fe0dc099530 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:41.937 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-01-26T15:21:41.937 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:42.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.034 7f0e20f28700 1 Processor -- start 2020-01-26T15:21:42.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.034 7f0e20f28700 1 -- - start start 2020-01-26T15:21:42.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c14bb10 con 0 2020-01-26T15:21:42.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c14beb0 con 0 2020-01-26T15:21:42.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e1ad71700 1 -- 172.21.15.129:0/4214490557 learned_addr learned my addr 172.21.15.129:0/4214490557 2020-01-26T15:21:42.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e100022a0 con 0x7f0e1c14b3d0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3646468307 0 0) 0x7f0e10002620 con 0x7f0e1c14b3d0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e00002a20 con 0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e0c0039b0 con 0x7f0e1c1480d0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2432468449 0 0) 0x7f0e0c003cb0 con 0x7f0e1c1480d0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0e000046c0 con 0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (173344551 0 0) 0x7f0e10002b20 con 0x7f0e1c14b3d0 2020-01-26T15:21:42.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 >> 172.21.15.129:6790/0 conn(0x7f0e1c1480d0 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:21:42.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c07a930 con 0 2020-01-26T15:21:42.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e1c116e80 con 0x7f0e1c14b3d0 2020-01-26T15:21:42.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e19d6f700 1 -- 172.21.15.129:0/4214490557 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e10001010 con 0x7f0e1c14b3d0 2020-01-26T15:21:42.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- 172.21.15.129:0/4214490557 >> 172.21.15.129:6791/0 conn(0x7f0e1c14b3d0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:21:42.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- 172.21.15.129:0/4214490557 shutdown_connections 2020-01-26T15:21:42.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- 172.21.15.129:0/4214490557 shutdown_connections 2020-01-26T15:21:42.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- 172.21.15.129:0/4214490557 wait complete. 2020-01-26T15:21:42.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.038 7f0e20f28700 1 -- 172.21.15.129:0/4214490557 >> 172.21.15.129:0/4214490557 conn(0x7f0e1c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e20f28700 1 Processor -- start 2020-01-26T15:21:42.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e20f28700 1 -- - start start 2020-01-26T15:21:42.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e20f28700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0a3f10 con 0 2020-01-26T15:21:42.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e20f28700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c092c10 con 0 2020-01-26T15:21:42.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e1ad71700 1 -- 172.21.15.129:0/2405664646 learned_addr learned my addr 172.21.15.129:0/2405664646 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e0c0042e0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (476586440 0 0) 0x7f0e0c0037f0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0df8002960 con 0 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e10000e50 con 0x7f0e1c0a52d0 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2545885940 0 0) 0x7f0e10001530 con 0x7f0e1c0a52d0 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.042 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0df8004620 con 0 2020-01-26T15:21:42.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (312404174 0 0) 0x7f0e0c0011d0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0df8002ee0 con 0 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1964477228 0 0) 0x7f0e100018b0 con 0x7f0e1c0a52d0 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0df8003540 con 0 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2218796958 0 0) 0x7f0e0c0016e0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 >> 172.21.15.129:6789/0 conn(0x7f0e1c0a52d0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c07ab90 con 0 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c0712f0 con 0 2020-01-26T15:21:42.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c0a6da0 con 0 2020-01-26T15:21:42.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0e1c0e9ff0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0e0c001b10 con 0x7f0e1c0a3520 2020-01-26T15:21:42.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f0e0c001d50 con 0x7f0e1c0a3520 2020-01-26T15:21:42.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.046 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1982677802 0 0) 0x7f0e0c005ef0 con 0x7f0e1c0a3520 2020-01-26T15:21:42.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.050 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc002070 con 0 2020-01-26T15:21:42.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.054 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0e0c004890 con 0x7f0e1c0a3520 2020-01-26T15:21:42.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.146 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dfc001220 con 0 2020-01-26T15:21:42.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.146 7f0e0bfff700 1 -- 172.21.15.129:0/2405664646 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+4100 (238102980 0 3313713272) 0x7f0e0c004c20 con 0x7f0e1c0a3520 2020-01-26T15:21:42.149 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:42.149 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":11,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:41.909173","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:42.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 >> 172.21.15.129:6800/11038 conn(0x7f0df8006ed0 :-1 s=STATE_OPEN pgs=22 cs=1 l=1).mark_down 2020-01-26T15:21:42.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 >> 172.21.15.129:6790/0 conn(0x7f0e1c0a3520 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:21:42.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 shutdown_connections 2020-01-26T15:21:42.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 shutdown_connections 2020-01-26T15:21:42.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 wait complete. 2020-01-26T15:21:42.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.150 7f0e20f28700 1 -- 172.21.15.129:0/2405664646 >> 172.21.15.129:0/2405664646 conn(0x7f0e1c0995b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:42.166 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:42.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 Processor -- start 2020-01-26T15:21:42.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- - start start 2020-01-26T15:21:42.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13014bb50 con 0 2020-01-26T15:21:42.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13014bef0 con 0 2020-01-26T15:21:42.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12ffff700 1 -- 172.21.15.129:0/416630177 learned_addr learned my addr 172.21.15.129:0/416630177 2020-01-26T15:21:42.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1280039b0 con 0x7ff130148110 2020-01-26T15:21:42.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1676108694 0 0) 0x7ff128003d30 con 0x7ff130148110 2020-01-26T15:21:42.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff11c002a20 con 0 2020-01-26T15:21:42.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1240022a0 con 0x7ff13014b410 2020-01-26T15:21:42.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2831184885 0 0) 0x7ff1240025a0 con 0x7ff13014b410 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff11c0046b0 con 0 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (390690094 0 0) 0x7ff128004300 con 0x7ff130148110 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 >> 172.21.15.129:6790/0 conn(0x7ff13014b410 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13007a8b0 con 0 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff1300ea030 con 0x7ff130148110 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff12effd700 1 -- 172.21.15.129:0/416630177 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1280013d0 con 0x7ff130148110 2020-01-26T15:21:42.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- 172.21.15.129:0/416630177 >> 172.21.15.129:6789/0 conn(0x7ff130148110 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:21:42.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- 172.21.15.129:0/416630177 shutdown_connections 2020-01-26T15:21:42.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- 172.21.15.129:0/416630177 shutdown_connections 2020-01-26T15:21:42.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- 172.21.15.129:0/416630177 wait complete. 2020-01-26T15:21:42.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.258 7ff1361cc700 1 -- 172.21.15.129:0/416630177 >> 172.21.15.129:0/416630177 conn(0x7ff130144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 Processor -- start 2020-01-26T15:21:42.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 -- - start start 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300a3c80 con 0 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300a6a50 con 0 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12f7fe700 1 -- 172.21.15.129:0/2851452034 learned_addr learned my addr 172.21.15.129:0/2851452034 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1280011d0 con 0x7ff1300a3290 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1240020e0 con 0x7ff1300a62a0 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (712575574 0 0) 0x7ff128003700 con 0x7ff1300a3290 2020-01-26T15:21:42.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff110002df0 con 0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (928917432 0 0) 0x7ff1240023e0 con 0x7ff1300a62a0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff110004620 con 0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (466627184 0 0) 0x7ff128003a80 con 0x7ff1300a3290 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff110004df0 con 0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2856497648 0 0) 0x7ff124002650 con 0x7ff1300a62a0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1100034b0 con 0 2020-01-26T15:21:42.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (780755727 0 0) 0x7ff1280018f0 con 0x7ff1300a3290 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 >> 172.21.15.129:6789/0 conn(0x7ff1300a62a0 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13007ab10 con 0 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1300b28d0 con 0 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13018b1e0 con 0 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff128000f70 con 0x7ff1300a3290 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff128001d20 con 0x7ff1300a3290 2020-01-26T15:21:42.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7ff1280049e0 con 0x7ff1300a3290 2020-01-26T15:21:42.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.262 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1982677802 0 0) 0x7ff128004cc0 con 0x7ff1300a3290 2020-01-26T15:21:42.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.274 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c002070 con 0 2020-01-26T15:21:42.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.278 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff1280046d0 con 0x7ff1300a3290 2020-01-26T15:21:42.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7ff10c001270 con 0 2020-01-26T15:21:42.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff12d7fa700 1 -- 172.21.15.129:0/2851452034 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v11) v1 ==== 92+0+10 (846493769 0 265718887) 0x7ff1280052e0 con 0x7ff1300a3290 2020-01-26T15:21:42.372 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:42.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 >> 172.21.15.129:6800/11038 conn(0x7ff1100072a0 :-1 s=STATE_OPEN pgs=23 cs=1 l=1).mark_down 2020-01-26T15:21:42.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 >> 172.21.15.129:6791/0 conn(0x7ff1300a3290 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:21:42.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 shutdown_connections 2020-01-26T15:21:42.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 shutdown_connections 2020-01-26T15:21:42.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 wait complete. 2020-01-26T15:21:42.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.370 7ff1361cc700 1 -- 172.21.15.129:0/2851452034 >> 172.21.15.129:0/2851452034 conn(0x7ff1300993b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.382 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-01-26T15:21:42.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 Processor -- start 2020-01-26T15:21:42.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- - start start 2020-01-26T15:21:42.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b414bb10 con 0 2020-01-26T15:21:42.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b414beb0 con 0 2020-01-26T15:21:42.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b8fac700 1 -- 172.21.15.129:0/444019267 learned_addr learned my addr 172.21.15.129:0/444019267 2020-01-26T15:21:42.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a8003630 con 0x7f29b41480d0 2020-01-26T15:21:42.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1334424726 0 0) 0x7f29a80039b0 con 0x7f29b41480d0 2020-01-26T15:21:42.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2998002a20 con 0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a00022a0 con 0x7f29b414b3d0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1425339636 0 0) 0x7f29a00025a0 con 0x7f29b414b3d0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f29980046c0 con 0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3269364724 0 0) 0x7f29a0002a40 con 0x7f29b414b3d0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 >> 172.21.15.129:6791/0 conn(0x7f29b41480d0 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b407a930 con 0 2020-01-26T15:21:42.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f29b4116e80 con 0x7f29b414b3d0 2020-01-26T15:21:42.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29b37fe700 1 -- 172.21.15.129:0/444019267 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a0000e50 con 0x7f29b414b3d0 2020-01-26T15:21:42.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- 172.21.15.129:0/444019267 >> 172.21.15.129:6789/0 conn(0x7f29b414b3d0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:21:42.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- 172.21.15.129:0/444019267 shutdown_connections 2020-01-26T15:21:42.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- 172.21.15.129:0/444019267 shutdown_connections 2020-01-26T15:21:42.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- 172.21.15.129:0/444019267 wait complete. 2020-01-26T15:21:42.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.474 7f29baf86700 1 -- 172.21.15.129:0/444019267 >> 172.21.15.129:0/444019267 conn(0x7f29b4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29baf86700 1 Processor -- start 2020-01-26T15:21:42.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29baf86700 1 -- - start start 2020-01-26T15:21:42.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29baf86700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40a3d70 con 0 2020-01-26T15:21:42.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29baf86700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40a6b40 con 0 2020-01-26T15:21:42.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b8fac700 1 -- 172.21.15.129:0/1174098387 learned_addr learned my addr 172.21.15.129:0/1174098387 2020-01-26T15:21:42.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a8003440 con 0x7f29b40a3380 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1809700816 0 0) 0x7f29a8003700 con 0x7f29b40a3380 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f299c002960 con 0 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a0002a40 con 0x7f29b40a6390 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2920076499 0 0) 0x7f29a0002080 con 0x7f29b40a6390 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.478 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f299c004620 con 0 2020-01-26T15:21:42.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1964892431 0 0) 0x7f29a0002410 con 0x7f29b40a6390 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f299c002ee0 con 0 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2567347373 0 0) 0x7f29a8000e50 con 0x7f29b40a3380 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f299c003540 con 0 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (694181792 0 0) 0x7f29a0001610 con 0x7f29b40a6390 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 >> 172.21.15.129:6789/0 conn(0x7f29b40a3380 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b407ab90 con 0 2020-01-26T15:21:42.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f29a0000bf0 con 0x7f29b40a6390 2020-01-26T15:21:42.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29baf86700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40b2970 con 0 2020-01-26T15:21:42.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f29a0001a40 con 0x7f29b40a6390 2020-01-26T15:21:42.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29baf86700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b418b200 con 0 2020-01-26T15:21:42.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f29a00035d0 con 0x7f29b40a6390 2020-01-26T15:21:42.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.482 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1982677802 0 0) 0x7f29a00038b0 con 0x7f29b40a6390 2020-01-26T15:21:42.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.486 7f29baf86700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b407af30 con 0 2020-01-26T15:21:42.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.490 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f29b407af30 con 0x7f29b40a6390 2020-01-26T15:21:42.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f29b4073330 con 0 2020-01-26T15:21:42.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29b1ffb700 1 -- 172.21.15.129:0/1174098387 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v11) v1 ==== 84+0+64 (203525128 0 1889981992) 0x7f29a00030b0 con 0x7f29b40a6390 2020-01-26T15:21:42.584 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:42.584 INFO:teuthology.orchestra.run.smithi129.stdout:[ 2020-01-26T15:21:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:21:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "poolnum": 1, 2020-01-26T15:21:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: "poolname": "rbd" 2020-01-26T15:21:42.585 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:21:42.585 INFO:teuthology.orchestra.run.smithi129.stdout:] 2020-01-26T15:21:42.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 >> 172.21.15.129:6800/11038 conn(0x7f299c006ed0 :-1 s=STATE_OPEN pgs=24 cs=1 l=1).mark_down 2020-01-26T15:21:42.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 >> 172.21.15.129:6791/0 conn(0x7f29b40a6390 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:21:42.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 shutdown_connections 2020-01-26T15:21:42.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 shutdown_connections 2020-01-26T15:21:42.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 wait complete. 2020-01-26T15:21:42.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.582 7f29baf86700 1 -- 172.21.15.129:0/1174098387 >> 172.21.15.129:0/1174098387 conn(0x7f29b4099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.601 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-01-26T15:21:42.601 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-01-26T15:21:42.697 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.694 7f501cb37700 1 Processor -- start 2020-01-26T15:21:42.698 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.694 7f501cb37700 1 -- - start start 2020-01-26T15:21:42.698 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.694 7f501cb37700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501814bb50 con 0 2020-01-26T15:21:42.698 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.694 7f501cb37700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501814bef0 con 0 2020-01-26T15:21:42.699 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5016a68700 1 -- 172.21.15.129:0/3056607378 learned_addr learned my addr 172.21.15.129:0/3056607378 2020-01-26T15:21:42.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f50080039b0 con 0x7f5018148110 2020-01-26T15:21:42.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f500c0022a0 con 0x7f501814b410 2020-01-26T15:21:42.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1629052608 0 0) 0x7f5008003d30 con 0x7f5018148110 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4ffc002ea0 con 0 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1577880546 0 0) 0x7f500c002620 con 0x7f501814b410 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4ffc0046b0 con 0 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (72818357 0 0) 0x7f5008004220 con 0x7f5018148110 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 >> 172.21.15.129:6790/0 conn(0x7f501814b410 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:21:42.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501807a8b0 con 0 2020-01-26T15:21:42.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f50180ea030 con 0x7f5018148110 2020-01-26T15:21:42.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f5015a66700 1 -- 172.21.15.129:0/3056607378 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5008001390 con 0x7f5018148110 2020-01-26T15:21:42.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f501cb37700 1 -- 172.21.15.129:0/3056607378 >> 172.21.15.129:6789/0 conn(0x7f5018148110 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:21:42.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f501cb37700 1 -- 172.21.15.129:0/3056607378 shutdown_connections 2020-01-26T15:21:42.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f501cb37700 1 -- 172.21.15.129:0/3056607378 shutdown_connections 2020-01-26T15:21:42.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f501cb37700 1 -- 172.21.15.129:0/3056607378 wait complete. 2020-01-26T15:21:42.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.698 7f501cb37700 1 -- 172.21.15.129:0/3056607378 >> 172.21.15.129:0/3056607378 conn(0x7f5018144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 Processor -- start 2020-01-26T15:21:42.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 -- - start start 2020-01-26T15:21:42.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180a3ca0 con 0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180a5150 con 0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5016a68700 1 -- 172.21.15.129:0/785436083 learned_addr learned my addr 172.21.15.129:0/785436083 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f50080011d0 con 0x7f50180a33a0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (505130538 0 0) 0x7f5008003760 con 0x7f50180a33a0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4ff4002960 con 0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f500c0020e0 con 0x7f5018095be0 2020-01-26T15:21:42.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1281087138 0 0) 0x7f500c0029a0 con 0x7f5018095be0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4ff4004620 con 0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1091220585 0 0) 0x7f5008003cd0 con 0x7f50180a33a0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ff4002ee0 con 0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3827454215 0 0) 0x7f5008001b50 con 0x7f50180a33a0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 >> 172.21.15.129:6791/0 conn(0x7f5018095be0 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501807ab10 con 0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50180b26e0 con 0 2020-01-26T15:21:42.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f50080016a0 con 0x7f50180a33a0 2020-01-26T15:21:42.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5008001f80 con 0x7f50180a33a0 2020-01-26T15:21:42.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f501cb37700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f50180a69c0 con 0 2020-01-26T15:21:42.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f5008004b00 con 0x7f50180a33a0 2020-01-26T15:21:42.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.702 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2207+0+0 (1982677802 0 0) 0x7f50080056d0 con 0x7f50180a33a0 2020-01-26T15:21:42.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.710 7f501cb37700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501807ae90 con 0 2020-01-26T15:21:42.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.714 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f501807ae90 con 0x7f50180a33a0 2020-01-26T15:21:42.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.806 7f501cb37700 1 -- 172.21.15.129:0/785436083 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f5018073260 con 0 2020-01-26T15:21:42.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.926 7f5007fff700 1 -- 172.21.15.129:0/785436083 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v12) v1 ==== 133+0+0 (3604228011 0 0) 0x7f50080045e0 con 0x7f50180a33a0 2020-01-26T15:21:42.971 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'cephfs_metadata' created 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 >> 172.21.15.129:6800/11038 conn(0x7f4ff40065f0 :-1 s=STATE_OPEN pgs=25 cs=1 l=1).mark_down 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 >> 172.21.15.129:6790/0 conn(0x7f50180a33a0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 shutdown_connections 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 shutdown_connections 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 wait complete. 2020-01-26T15:21:42.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:42.970 7f501cb37700 1 -- 172.21.15.129:0/785436083 >> 172.21.15.129:0/785436083 conn(0x7f50180994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:42.986 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2020-01-26T15:21:43.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.082 7fd3b70e3700 1 Processor -- start 2020-01-26T15:21:43.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.082 7fd3b70e3700 1 -- - start start 2020-01-26T15:21:43.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b014bb50 con 0 2020-01-26T15:21:43.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b014bef0 con 0 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b5109700 1 -- 172.21.15.129:0/3042477752 learned_addr learned my addr 172.21.15.129:0/3042477752 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a00039b0 con 0x7fd3b0148110 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (83336313 0 0) 0x7fd3a0003d30 con 0x7fd3b0148110 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd39c0029d0 con 0 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a40022a0 con 0x7fd3b014b410 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3109552456 0 0) 0x7fd3a4002620 con 0x7fd3b014b410 2020-01-26T15:21:43.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd39c004810 con 0 2020-01-26T15:21:43.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (714632195 0 0) 0x7fd3a0004300 con 0x7fd3b0148110 2020-01-26T15:21:43.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 >> 172.21.15.129:6789/0 conn(0x7fd3b014b410 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:21:43.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b007a8b0 con 0 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd3b00ea030 con 0x7fd3b0148110 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3affff700 1 -- 172.21.15.129:0/3042477752 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a00013d0 con 0x7fd3b0148110 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- 172.21.15.129:0/3042477752 >> 172.21.15.129:6791/0 conn(0x7fd3b0148110 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- 172.21.15.129:0/3042477752 shutdown_connections 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- 172.21.15.129:0/3042477752 shutdown_connections 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- 172.21.15.129:0/3042477752 wait complete. 2020-01-26T15:21:43.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.086 7fd3b70e3700 1 -- 172.21.15.129:0/3042477752 >> 172.21.15.129:0/3042477752 conn(0x7fd3b0144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:43.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 Processor -- start 2020-01-26T15:21:43.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 -- - start start 2020-01-26T15:21:43.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b00a3c50 con 0 2020-01-26T15:21:43.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b00a68c0 con 0 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b4908700 1 -- 172.21.15.129:0/1781377094 learned_addr learned my addr 172.21.15.129:0/1781377094 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a40020e0 con 0x7fd3b00a6270 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a00011d0 con 0x7fd3b00a3260 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3538415484 0 0) 0x7fd3a40023e0 con 0x7fd3b00a6270 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd390002e50 con 0 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2323849940 0 0) 0x7fd3a00018f0 con 0x7fd3b00a3260 2020-01-26T15:21:43.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd390004680 con 0 2020-01-26T15:21:43.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2727858984 0 0) 0x7fd3a4000e50 con 0x7fd3b00a6270 2020-01-26T15:21:43.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd390004d40 con 0 2020-01-26T15:21:43.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1602596161 0 0) 0x7fd3a0001c70 con 0x7fd3b00a3260 2020-01-26T15:21:43.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd3900054e0 con 0 2020-01-26T15:21:43.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2315678794 0 0) 0x7fd3a4001360 con 0x7fd3b00a6270 2020-01-26T15:21:43.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 >> 172.21.15.129:6790/0 conn(0x7fd3b00a3260 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b007ab10 con 0 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00b2610 con 0 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b018b0d0 con 0 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd3b0116ec0 con 0x7fd3b00a6270 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd3a4001790 con 0x7fd3b00a6270 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fd3a40019d0 con 0x7fd3b00a6270 2020-01-26T15:21:43.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.090 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 2477+0+0 (1692630400 0 0) 0x7fd3a4005aa0 con 0x7fd3b00a6270 2020-01-26T15:21:43.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.098 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c002070 con 0 2020-01-26T15:21:43.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.106 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd3a4003f90 con 0x7fd3b00a6270 2020-01-26T15:21:43.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.198 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7fd38c0012a0 con 0 2020-01-26T15:21:43.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.930 7fd3ae7fc700 1 -- 172.21.15.129:0/1781377094 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v13) v1 ==== 125+0+0 (4153913060 0 0) 0x7fd3a4004c60 con 0x7fd3b00a6270 2020-01-26T15:21:43.963 INFO:teuthology.orchestra.run.smithi129.stderr:pool 'cephfs_data' created 2020-01-26T15:21:43.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 >> 172.21.15.129:6800/11038 conn(0x7fd390006e70 :-1 s=STATE_OPEN pgs=26 cs=1 l=1).mark_down 2020-01-26T15:21:43.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 >> 172.21.15.129:6791/0 conn(0x7fd3b00a6270 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:21:43.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 shutdown_connections 2020-01-26T15:21:43.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 shutdown_connections 2020-01-26T15:21:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 wait complete. 2020-01-26T15:21:43.967 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:43.962 7fd3b70e3700 1 -- 172.21.15.129:0/1781377094 >> 172.21.15.129:0/1781377094 conn(0x7fd3b0099350 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:43.978 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-01-26T15:21:44.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f26652b1700 1 Processor -- start 2020-01-26T15:21:44.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f26652b1700 1 -- - start start 2020-01-26T15:21:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f26652b1700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266014bb40 con 0 2020-01-26T15:21:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f26652b1700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266014bee0 con 0 2020-01-26T15:21:44.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265ea68700 1 -- 172.21.15.129:0/926381684 learned_addr learned my addr 172.21.15.129:0/926381684 2020-01-26T15:21:44.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2654003630 con 0x7f266014b400 2020-01-26T15:21:44.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1835001390 0 0) 0x7f26540039b0 con 0x7f266014b400 2020-01-26T15:21:44.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f264c002a20 con 0 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2650002620 con 0x7f2660148100 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4012017151 0 0) 0x7f2650002920 con 0x7f2660148100 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f264c0046c0 con 0 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1501909245 0 0) 0x7f2654003f80 con 0x7f266014b400 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 >> 172.21.15.129:6789/0 conn(0x7f2660148100 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.070 7f265e267700 1 -- 172.21.15.129:0/926381684 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266007a960 con 0 2020-01-26T15:21:44.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2660116eb0 con 0x7f266014b400 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f265e267700 1 -- 172.21.15.129:0/926381684 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2654001050 con 0x7f266014b400 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f26652b1700 1 -- 172.21.15.129:0/926381684 >> 172.21.15.129:6790/0 conn(0x7f266014b400 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f26652b1700 1 -- 172.21.15.129:0/926381684 shutdown_connections 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f26652b1700 1 -- 172.21.15.129:0/926381684 shutdown_connections 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f26652b1700 1 -- 172.21.15.129:0/926381684 wait complete. 2020-01-26T15:21:44.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.074 7f26652b1700 1 -- 172.21.15.129:0/926381684 >> 172.21.15.129:0/926381684 conn(0x7f2660144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 Processor -- start 2020-01-26T15:21:44.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 -- - start start 2020-01-26T15:21:44.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600a3e30 con 0 2020-01-26T15:21:44.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600a6b70 con 0 2020-01-26T15:21:44.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265f269700 1 -- 172.21.15.129:0/78105804 learned_addr learned my addr 172.21.15.129:0/78105804 2020-01-26T15:21:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2654000e50 con 0x7f26600a63c0 2020-01-26T15:21:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (583218372 0 0) 0x7f2654001570 con 0x7f26600a63c0 2020-01-26T15:21:44.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2640002960 con 0 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2650002430 con 0x7f26600a3440 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4164465783 0 0) 0x7f2650002730 con 0x7f26600a3440 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2640004620 con 0 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (805051849 0 0) 0x7f26500029a0 con 0x7f26600a3440 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2640002ee0 con 0 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1858922412 0 0) 0x7f26540019c0 con 0x7f26600a63c0 2020-01-26T15:21:44.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2640003540 con 0 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (93402383 0 0) 0x7f2650001470 con 0x7f26600a3440 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 >> 172.21.15.129:6791/0 conn(0x7f26600a63c0 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266007abc0 con 0 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26600b27e0 con 0 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f26600ea020 con 0x7f26600a3440 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f26500018e0 con 0x7f26600a3440 2020-01-26T15:21:44.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f26652b1700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f266018b230 con 0 2020-01-26T15:21:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f2650001df0 con 0x7f26600a3440 2020-01-26T15:21:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.078 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 2743+0+0 (185723773 0 0) 0x7f2650004f90 con 0x7f26600a3440 2020-01-26T15:21:44.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.082 7f26652b1700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266007af60 con 0 2020-01-26T15:21:44.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.086 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f266007af60 con 0x7f26600a3440 2020-01-26T15:21:44.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.182 7f26652b1700 1 -- 172.21.15.129:0/78105804 --> 172.21.15.129:6790/0 -- mon_command({"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f2660073330 con 0 2020-01-26T15:21:44.186 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26 15:21:44.182 7f5147ee4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-01-26T15:21:44.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.194 7f265ca64700 1 -- 172.21.15.129:0/78105804 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"data": "cephfs_data", "prefix": "fs new", "force": "--force", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 192+0+0 (3633460107 0 0) 0x7f2650004990 con 0x7f26600a3440 2020-01-26T15:21:44.200 INFO:teuthology.orchestra.run.smithi129.stderr:new fs with metadata pool 2 and data pool 3 2020-01-26T15:21:44.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 >> 172.21.15.129:6800/11038 conn(0x7f2640006ed0 :-1 s=STATE_OPEN pgs=27 cs=1 l=1).mark_down 2020-01-26T15:21:44.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 >> 172.21.15.129:6790/0 conn(0x7f26600a3440 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:21:44.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 shutdown_connections 2020-01-26T15:21:44.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 shutdown_connections 2020-01-26T15:21:44.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 wait complete. 2020-01-26T15:21:44.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.202 7f26652b1700 1 -- 172.21.15.129:0/78105804 >> 172.21.15.129:0/78105804 conn(0x7f2660099530 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.212 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:44.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 Processor -- start 2020-01-26T15:21:44.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- - start start 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e814bb10 con 0 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e814beb0 con 0 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e6cf4700 1 -- 172.21.15.129:0/1380796877 learned_addr learned my addr 172.21.15.129:0/1380796877 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49dc0022a0 con 0x7f49e814b3d0 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49d8003630 con 0x7f49e81480d0 2020-01-26T15:21:44.293 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1700421470 0 0) 0x7f49dc002620 con 0x7f49e814b3d0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f49cc002ea0 con 0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2658498752 0 0) 0x7f49d8003930 con 0x7f49e81480d0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f49cc0046b0 con 0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2387376262 0 0) 0x7f49dc002ac0 con 0x7f49e814b3d0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 >> 172.21.15.129:6791/0 conn(0x7f49e81480d0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e807a930 con 0 2020-01-26T15:21:44.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f49e8116e80 con 0x7f49e814b3d0 2020-01-26T15:21:44.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49e5cf2700 1 -- 172.21.15.129:0/1380796877 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49dc001010 con 0x7f49e814b3d0 2020-01-26T15:21:44.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- 172.21.15.129:0/1380796877 >> 172.21.15.129:6789/0 conn(0x7f49e814b3d0 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:21:44.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- 172.21.15.129:0/1380796877 shutdown_connections 2020-01-26T15:21:44.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- 172.21.15.129:0/1380796877 shutdown_connections 2020-01-26T15:21:44.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- 172.21.15.129:0/1380796877 wait complete. 2020-01-26T15:21:44.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.290 7f49ecd3d700 1 -- 172.21.15.129:0/1380796877 >> 172.21.15.129:0/1380796877 conn(0x7f49e8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49ecd3d700 1 Processor -- start 2020-01-26T15:21:44.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49ecd3d700 1 -- - start start 2020-01-26T15:21:44.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49ecd3d700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80a3d80 con 0 2020-01-26T15:21:44.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49ecd3d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80a6b50 con 0 2020-01-26T15:21:44.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49e64f3700 1 -- 172.21.15.129:0/3431354025 learned_addr learned my addr 172.21.15.129:0/3431354025 2020-01-26T15:21:44.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49dc001010 con 0x7f49e80a63a0 2020-01-26T15:21:44.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1671279917 0 0) 0x7f49dc002050 con 0x7f49e80a63a0 2020-01-26T15:21:44.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f49c4002960 con 0 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49d8003e70 con 0x7f49e80a3390 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2874614639 0 0) 0x7f49d8003410 con 0x7f49e80a3390 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f49c4004620 con 0 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (674561621 0 0) 0x7f49dc0025c0 con 0x7f49e80a63a0 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49c4002ee0 con 0 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1877934820 0 0) 0x7f49d8003680 con 0x7f49e80a3390 2020-01-26T15:21:44.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.294 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49c4003540 con 0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2520197117 0 0) 0x7f49dc001920 con 0x7f49e80a63a0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 >> 172.21.15.129:6791/0 conn(0x7f49e80a3390 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e807ab90 con 0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b27b0 con 0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e818b200 con 0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f49dc001320 con 0x7f49e80a63a0 2020-01-26T15:21:44.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f49dc002e50 con 0x7f49e80a63a0 2020-01-26T15:21:44.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f49dc003630 con 0x7f49e80a63a0 2020-01-26T15:21:44.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.298 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3035290104 0 0) 0x7f49dc003c30 con 0x7f49e80a63a0 2020-01-26T15:21:44.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.302 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e807af30 con 0 2020-01-26T15:21:44.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.306 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f49e807af30 con 0x7f49e80a63a0 2020-01-26T15:21:44.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e8070d10 con 0 2020-01-26T15:21:44.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49d7fff700 1 -- 172.21.15.129:0/3431354025 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 4202297492) 0x7f49dc003340 con 0x7f49e80a63a0 2020-01-26T15:21:44.404 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:44.405 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":14,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:44.187080","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:44.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 >> 172.21.15.129:6800/11038 conn(0x7f49c4006e70 :-1 s=STATE_OPEN pgs=28 cs=1 l=1).mark_down 2020-01-26T15:21:44.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 >> 172.21.15.129:6790/0 conn(0x7f49e80a63a0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:21:44.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 shutdown_connections 2020-01-26T15:21:44.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 shutdown_connections 2020-01-26T15:21:44.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 wait complete. 2020-01-26T15:21:44.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.402 7f49ecd3d700 1 -- 172.21.15.129:0/3431354025 >> 172.21.15.129:0/3431354025 conn(0x7f49e8099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.422 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:44.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.510 7f47466d2700 1 Processor -- start 2020-01-26T15:21:44.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.510 7f47466d2700 1 -- - start start 2020-01-26T15:21:44.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.510 7f47466d2700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474014bb60 con 0 2020-01-26T15:21:44.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.510 7f47466d2700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474014bf00 con 0 2020-01-26T15:21:44.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473ffff700 1 -- 172.21.15.129:0/76806859 learned_addr learned my addr 172.21.15.129:0/76806859 2020-01-26T15:21:44.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4730003630 con 0x7f47401480d0 2020-01-26T15:21:44.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f47340022a0 con 0x7f474014b3d0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3969614261 0 0) 0x7f47300039b0 con 0x7f47401480d0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f472c002ea0 con 0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4149104894 0 0) 0x7f47340025a0 con 0x7f474014b3d0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f472c0046b0 con 0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1320864450 0 0) 0x7f4734002a40 con 0x7f474014b3d0 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 >> 172.21.15.129:6790/0 conn(0x7f47401480d0 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-01-26T15:21:44.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474007a930 con 0 2020-01-26T15:21:44.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4740116e80 con 0x7f474014b3d0 2020-01-26T15:21:44.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f473effd700 1 -- 172.21.15.129:0/76806859 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4734001010 con 0x7f474014b3d0 2020-01-26T15:21:44.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f47466d2700 1 -- 172.21.15.129:0/76806859 >> 172.21.15.129:6789/0 conn(0x7f474014b3d0 :-1 s=STATE_OPEN pgs=33 cs=1 l=1).mark_down 2020-01-26T15:21:44.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f47466d2700 1 -- 172.21.15.129:0/76806859 shutdown_connections 2020-01-26T15:21:44.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f47466d2700 1 -- 172.21.15.129:0/76806859 shutdown_connections 2020-01-26T15:21:44.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f47466d2700 1 -- 172.21.15.129:0/76806859 wait complete. 2020-01-26T15:21:44.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.514 7f47466d2700 1 -- 172.21.15.129:0/76806859 >> 172.21.15.129:0/76806859 conn(0x7f4740144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 Processor -- start 2020-01-26T15:21:44.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 -- - start start 2020-01-26T15:21:44.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400a3e50 con 0 2020-01-26T15:21:44.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400a6bd0 con 0 2020-01-26T15:21:44.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473f7fe700 1 -- 172.21.15.129:0/1342165863 learned_addr learned my addr 172.21.15.129:0/1342165863 2020-01-26T15:21:44.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4734000e50 con 0x7f47400a6420 2020-01-26T15:21:44.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3890363709 0 0) 0x7f47340020b0 con 0x7f47400a6420 2020-01-26T15:21:44.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4720002960 con 0 2020-01-26T15:21:44.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4730003f40 con 0x7f47400a3410 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1558152129 0 0) 0x7f4730003470 con 0x7f47400a3410 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4720004620 con 0 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (516270059 0 0) 0x7f4734001530 con 0x7f47400a6420 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4720002ee0 con 0 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (802441317 0 0) 0x7f4730003880 con 0x7f47400a3410 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4720003540 con 0 2020-01-26T15:21:44.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (803166678 0 0) 0x7f4734001a40 con 0x7f47400a6420 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 >> 172.21.15.129:6790/0 conn(0x7f47400a3410 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474007ab90 con 0 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47400b2940 con 0 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f47466d2700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f474018b2f0 con 0 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4734001320 con 0x7f47400a6420 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4734002e80 con 0x7f47400a6420 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f47340037f0 con 0x7f47400a6420 2020-01-26T15:21:44.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.518 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3035290104 0 0) 0x7f47340032d0 con 0x7f47400a6420 2020-01-26T15:21:44.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.526 7f47466d2700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c002070 con 0 2020-01-26T15:21:44.529 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.526 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4734018040 con 0x7f47400a6420 2020-01-26T15:21:44.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f471c001220 con 0 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f473d7fa700 1 -- 172.21.15.129:0/1342165863 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+6330 (92231148 0 4202297492) 0x7f47340068d0 con 0x7f47400a6420 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 >> 172.21.15.129:6800/11038 conn(0x7f4720006fc0 :-1 s=STATE_OPEN pgs=29 cs=1 l=1).mark_down 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 >> 172.21.15.129:6789/0 conn(0x7f47400a6420 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 shutdown_connections 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 shutdown_connections 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 wait complete. 2020-01-26T15:21:44.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.626 7f47466d2700 1 -- 172.21.15.129:0/1342165863 >> 172.21.15.129:0/1342165863 conn(0x7f4740099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.633 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:44.633 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":14,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:44.187080","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:44.649 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-01-26T15:21:44.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.734 7fb129a85700 1 Processor -- start 2020-01-26T15:21:44.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.734 7fb129a85700 1 -- - start start 2020-01-26T15:21:44.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.734 7fb129a85700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12414bb40 con 0 2020-01-26T15:21:44.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12414bee0 con 0 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb122ffd700 1 -- 172.21.15.129:0/267427822 learned_addr learned my addr 172.21.15.129:0/267427822 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb1140025a0 con 0x7fb124148100 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2400863830 0 0) 0x7fb114002920 con 0x7fb124148100 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb104002a20 con 0 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb10c003630 con 0x7fb12414b400 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2177983327 0 0) 0x7fb10c0039b0 con 0x7fb12414b400 2020-01-26T15:21:44.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb1040046c0 con 0 2020-01-26T15:21:44.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1677211760 0 0) 0x7fb114002ea0 con 0x7fb124148100 2020-01-26T15:21:44.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 >> 172.21.15.129:6791/0 conn(0x7fb12414b400 :-1 s=STATE_OPEN pgs=34 cs=1 l=1).mark_down 2020-01-26T15:21:44.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12407a8a0 con 0 2020-01-26T15:21:44.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb1240ea020 con 0x7fb124148100 2020-01-26T15:21:44.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb1227fc700 1 -- 172.21.15.129:0/267427822 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb114001390 con 0x7fb124148100 2020-01-26T15:21:44.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- 172.21.15.129:0/267427822 >> 172.21.15.129:6790/0 conn(0x7fb124148100 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-01-26T15:21:44.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- 172.21.15.129:0/267427822 shutdown_connections 2020-01-26T15:21:44.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- 172.21.15.129:0/267427822 shutdown_connections 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- 172.21.15.129:0/267427822 wait complete. 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- 172.21.15.129:0/267427822 >> 172.21.15.129:0/267427822 conn(0x7fb124144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 Processor -- start 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.738 7fb129a85700 1 -- - start start 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb129a85700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1240a3c90 con 0 2020-01-26T15:21:44.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb129a85700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1240a5140 con 0 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb1237fe700 1 -- 172.21.15.129:0/2255228868 learned_addr learned my addr 172.21.15.129:0/2255228868 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb114001390 con 0x7fb1240a3390 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (25555399 0 0) 0x7fb114001970 con 0x7fb1240a3390 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb108002960 con 0 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb10c003ef0 con 0x7fb124095bd0 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (867304731 0 0) 0x7fb10c003470 con 0x7fb124095bd0 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb108004620 con 0 2020-01-26T15:21:44.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3008002603 0 0) 0x7fb114001f40 con 0x7fb1240a3390 2020-01-26T15:21:44.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb108002ee0 con 0 2020-01-26T15:21:44.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (385175413 0 0) 0x7fb10c0038d0 con 0x7fb124095bd0 2020-01-26T15:21:44.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb108003540 con 0 2020-01-26T15:21:44.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2156309964 0 0) 0x7fb114002740 con 0x7fb1240a3390 2020-01-26T15:21:44.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 >> 172.21.15.129:6791/0 conn(0x7fb124095bd0 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12407ab00 con 0 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb129a85700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1240b26d0 con 0 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb129a85700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1240a69b0 con 0 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb114000f70 con 0x7fb1240a3390 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb114003250 con 0x7fb1240a3390 2020-01-26T15:21:44.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fb1140039b0 con 0x7fb1240a3390 2020-01-26T15:21:44.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.742 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 2811+0+0 (3035290104 0 0) 0x7fb1140066f0 con 0x7fb1240a3390 2020-01-26T15:21:44.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.750 7fb129a85700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc002070 con 0 2020-01-26T15:21:44.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.754 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb1140036a0 con 0x7fb1240a3390 2020-01-26T15:21:44.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:44.846 7fb129a85700 1 -- 172.21.15.129:0/2255228868 --> 172.21.15.129:6790/0 -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7fb0fc0012c0 con 0 2020-01-26T15:21:45.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.194 7fb120ff9700 1 -- 172.21.15.129:0/2255228868 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (2292374382 0 0) 0x7fb114002b70 con 0x7fb1240a3390 2020-01-26T15:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 >> 172.21.15.129:6800/11038 conn(0x7fb108006e70 :-1 s=STATE_OPEN pgs=30 cs=1 l=1).mark_down 2020-01-26T15:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 >> 172.21.15.129:6790/0 conn(0x7fb1240a3390 :-1 s=STATE_OPEN pgs=41 cs=1 l=1).mark_down 2020-01-26T15:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 shutdown_connections 2020-01-26T15:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 shutdown_connections 2020-01-26T15:21:45.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 wait complete. 2020-01-26T15:21:45.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.210 7fb129a85700 1 -- 172.21.15.129:0/2255228868 >> 172.21.15.129:0/2255228868 conn(0x7fb1240994a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.229 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:21:45.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb1c8f0700 1 Processor -- start 2020-01-26T15:21:45.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb1c8f0700 1 -- - start start 2020-01-26T15:21:45.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb1c8f0700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1814bb10 con 0 2020-01-26T15:21:45.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb1c8f0700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1814beb0 con 0 2020-01-26T15:21:45.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16826700 1 -- 172.21.15.129:0/1477563797 learned_addr learned my addr 172.21.15.129:0/1477563797 2020-01-26T15:21:45.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb08003630 con 0x7fbb181480d0 2020-01-26T15:21:45.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (978304748 0 0) 0x7fbb080039b0 con 0x7fbb181480d0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbaf8002a20 con 0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb000022a0 con 0x7fbb1814b3d0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4107770276 0 0) 0x7fbb000025a0 con 0x7fbb1814b3d0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbaf80046c0 con 0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3070598850 0 0) 0x7fbb08003f80 con 0x7fbb181480d0 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 >> 172.21.15.129:6790/0 conn(0x7fbb1814b3d0 :-1 s=STATE_OPEN pgs=42 cs=1 l=1).mark_down 2020-01-26T15:21:45.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1807a930 con 0 2020-01-26T15:21:45.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbb180e9ff0 con 0x7fbb181480d0 2020-01-26T15:21:45.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb16025700 1 -- 172.21.15.129:0/1477563797 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb08001050 con 0x7fbb181480d0 2020-01-26T15:21:45.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.318 7fbb1c8f0700 1 -- 172.21.15.129:0/1477563797 >> 172.21.15.129:6791/0 conn(0x7fbb181480d0 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:21:45.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- 172.21.15.129:0/1477563797 shutdown_connections 2020-01-26T15:21:45.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- 172.21.15.129:0/1477563797 shutdown_connections 2020-01-26T15:21:45.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- 172.21.15.129:0/1477563797 wait complete. 2020-01-26T15:21:45.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- 172.21.15.129:0/1477563797 >> 172.21.15.129:0/1477563797 conn(0x7fbb18144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 Processor -- start 2020-01-26T15:21:45.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- - start start 2020-01-26T15:21:45.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180a3de0 con 0 2020-01-26T15:21:45.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb1c8f0700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180a6bb0 con 0 2020-01-26T15:21:45.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb0e025700 1 -- 172.21.15.129:0/681669634 learned_addr learned my addr 172.21.15.129:0/681669634 2020-01-26T15:21:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb000020e0 con 0x7fbb180a6400 2020-01-26T15:21:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1347551445 0 0) 0x7fbb000023e0 con 0x7fbb180a6400 2020-01-26T15:21:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb14822700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbafc002960 con 0 2020-01-26T15:21:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.322 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb08000e50 con 0x7fbb180a33f0 2020-01-26T15:21:45.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (435577880 0 0) 0x7fbb08003380 con 0x7fbb180a33f0 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbafc004620 con 0 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (224126008 0 0) 0x7fbb00000e50 con 0x7fbb180a6400 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbafc002ee0 con 0 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (399762910 0 0) 0x7fbb08003710 con 0x7fbb180a33f0 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbafc003540 con 0 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (787894386 0 0) 0x7fbb000013f0 con 0x7fbb180a6400 2020-01-26T15:21:45.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 >> 172.21.15.129:6789/0 conn(0x7fbb180a33f0 :-1 s=STATE_OPEN pgs=35 cs=1 l=1).mark_down 2020-01-26T15:21:45.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1807ab90 con 0 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb180b2940 con 0 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1818b200 con 0 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbb00000bf0 con 0x7fbb180a6400 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbb00001820 con 0x7fbb180a6400 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fbb00001a60 con 0x7fbb180a6400 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.326 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fbb00005bf0 con 0x7fbb180a6400 2020-01-26T15:21:45.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.330 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1807af30 con 0 2020-01-26T15:21:45.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.334 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fbb1807af30 con 0x7fbb180a6400 2020-01-26T15:21:45.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.426 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb181563d0 con 0 2020-01-26T15:21:45.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.426 7fbb14822700 1 -- 172.21.15.129:0/681669634 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1415 (2837298644 0 747543494) 0x7fbb00003f90 con 0x7fbb180a6400 2020-01-26T15:21:45.430 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:45.430 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:21:45.191091","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:21:45.430 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 3 2020-01-26T15:21:45.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 >> 172.21.15.129:6800/11038 conn(0x7fbafc006e70 :-1 s=STATE_OPEN pgs=31 cs=1 l=1).mark_down 2020-01-26T15:21:45.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 >> 172.21.15.129:6791/0 conn(0x7fbb180a6400 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:21:45.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 shutdown_connections 2020-01-26T15:21:45.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 shutdown_connections 2020-01-26T15:21:45.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 wait complete. 2020-01-26T15:21:45.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.430 7fbb1c8f0700 1 -- 172.21.15.129:0/681669634 >> 172.21.15.129:0/681669634 conn(0x7fbb18099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.441 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 Processor -- start 2020-01-26T15:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- - start start 2020-01-26T15:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974414bb10 con 0 2020-01-26T15:21:45.531 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974414beb0 con 0 2020-01-26T15:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9743fff700 1 -- 172.21.15.129:0/249384096 learned_addr learned my addr 172.21.15.129:0/249384096 2020-01-26T15:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f97340039b0 con 0x7f97441480d0 2020-01-26T15:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2412963049 0 0) 0x7f9734003d30 con 0x7f97441480d0 2020-01-26T15:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9724002a20 con 0 2020-01-26T15:21:45.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f972c0022a0 con 0x7f974414b3d0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (950528221 0 0) 0x7f972c002620 con 0x7f974414b3d0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f97240046b0 con 0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1808478871 0 0) 0x7f9734004300 con 0x7f97441480d0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 >> 172.21.15.129:6790/0 conn(0x7f974414b3d0 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974407a930 con 0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f97440e9ff0 con 0x7f97441480d0 2020-01-26T15:21:45.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f9742ffd700 1 -- 172.21.15.129:0/249384096 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f97340013d0 con 0x7f97441480d0 2020-01-26T15:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- 172.21.15.129:0/249384096 >> 172.21.15.129:6789/0 conn(0x7f97441480d0 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- 172.21.15.129:0/249384096 shutdown_connections 2020-01-26T15:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- 172.21.15.129:0/249384096 shutdown_connections 2020-01-26T15:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- 172.21.15.129:0/249384096 wait complete. 2020-01-26T15:21:45.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.530 7f974a22f700 1 -- 172.21.15.129:0/249384096 >> 172.21.15.129:0/249384096 conn(0x7f9744144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 Processor -- start 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 -- - start start 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440a3de0 con 0 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9744095e10 con 0 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97437fe700 1 -- 172.21.15.129:0/1497196515 learned_addr learned my addr 172.21.15.129:0/1497196515 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f972c0022a0 con 0x7f97440a51a0 2020-01-26T15:21:45.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2213244482 0 0) 0x7f972c0029b0 con 0x7f97440a51a0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9728002960 con 0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f97340011d0 con 0x7f97440a33f0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3000901215 0 0) 0x7f9734003700 con 0x7f97440a33f0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9728004620 con 0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (758206985 0 0) 0x7f972c000f70 con 0x7f97440a51a0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9728002ee0 con 0 2020-01-26T15:21:45.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3790919452 0 0) 0x7f9734003bb0 con 0x7f97440a33f0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9728003540 con 0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4094633052 0 0) 0x7f972c0014e0 con 0x7f97440a51a0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 >> 172.21.15.129:6791/0 conn(0x7f97440a33f0 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974407ab90 con 0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97440712f0 con 0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f974a22f700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f97440a6c20 con 0 2020-01-26T15:21:45.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f972c000bf0 con 0x7f97440a51a0 2020-01-26T15:21:45.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f972c001910 con 0x7f97440a51a0 2020-01-26T15:21:45.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f972c0044b0 con 0x7f97440a51a0 2020-01-26T15:21:45.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.534 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f972c006010 con 0x7f97440a51a0 2020-01-26T15:21:45.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.542 7f974a22f700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c002070 con 0 2020-01-26T15:21:45.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.546 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f972c0049f0 con 0x7f97440a51a0 2020-01-26T15:21:45.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.638 7f974a22f700 1 -- 172.21.15.129:0/1497196515 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f971c0011f0 con 0 2020-01-26T15:21:45.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.638 7f97417fa700 1 -- 172.21.15.129:0/1497196515 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1195610651) 0x7f972c003f90 con 0x7f97440a51a0 2020-01-26T15:21:45.642 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:45.642 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":15,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:45.190225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:45.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 >> 172.21.15.129:6800/11038 conn(0x7f9728006e70 :-1 s=STATE_OPEN pgs=32 cs=1 l=1).mark_down 2020-01-26T15:21:45.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 >> 172.21.15.129:6789/0 conn(0x7f97440a51a0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:21:45.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 shutdown_connections 2020-01-26T15:21:45.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 shutdown_connections 2020-01-26T15:21:45.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 wait complete. 2020-01-26T15:21:45.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.642 7f974a22f700 1 -- 172.21.15.129:0/1497196515 >> 172.21.15.129:0/1497196515 conn(0x7f97440995d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.663 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-01-26T15:21:45.663 INFO:tasks.ceph.mds.a:Restarting daemon 2020-01-26T15:21:45.664 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-01-26T15:21:45.673 INFO:tasks.ceph.mds.a:Started 2020-01-26T15:21:45.673 INFO:tasks.ceph.mds.b:Restarting daemon 2020-01-26T15:21:45.673 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-01-26T15:21:45.681 INFO:tasks.ceph.mds.b:Started 2020-01-26T15:21:45.682 INFO:tasks.ceph.mds.c:Restarting daemon 2020-01-26T15:21:45.682 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-01-26T15:21:45.684 INFO:tasks.ceph.mds.c:Started 2020-01-26T15:21:45.685 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:45.685 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-01-26T15:21:45.746 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at - 2020-01-26T15:21:45.761 INFO:tasks.ceph.mds.a.smithi129.stdout:starting mds.a at - 2020-01-26T15:21:45.764 INFO:tasks.ceph.mds.c.smithi129.stdout:starting mds.c at - 2020-01-26T15:21:45.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c3ad5f700 1 Processor -- start 2020-01-26T15:21:45.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c3ad5f700 1 -- - start start 2020-01-26T15:21:45.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c3ad5f700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3414bb10 con 0 2020-01-26T15:21:45.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c3ad5f700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3414beb0 con 0 2020-01-26T15:21:45.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c38d85700 1 -- 172.21.15.129:0/1220899797 learned_addr learned my addr 172.21.15.129:0/1220899797 2020-01-26T15:21:45.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c200022a0 con 0x7f4c3414b3d0 2020-01-26T15:21:45.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1028686172 0 0) 0x7f4c20002620 con 0x7f4c3414b3d0 2020-01-26T15:21:45.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4c18002a20 con 0 2020-01-26T15:21:45.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c28003630 con 0x7f4c341480d0 2020-01-26T15:21:45.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1857361160 0 0) 0x7f4c28003930 con 0x7f4c341480d0 2020-01-26T15:21:45.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4c180046c0 con 0 2020-01-26T15:21:45.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3625865040 0 0) 0x7f4c28003dd0 con 0x7f4c341480d0 2020-01-26T15:21:45.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 >> 172.21.15.129:6790/0 conn(0x7f4c3414b3d0 :-1 s=STATE_OPEN_MESSAGE_READ_FRONT pgs=47 cs=1 l=1).mark_down 2020-01-26T15:21:45.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.774 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3407a930 con 0 2020-01-26T15:21:45.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4c340e9ff0 con 0x7f4c341480d0 2020-01-26T15:21:45.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c337fe700 1 -- 172.21.15.129:0/1220899797 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c28000e50 con 0x7f4c341480d0 2020-01-26T15:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/1220899797 >> 172.21.15.129:6791/0 conn(0x7f4c341480d0 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/1220899797 shutdown_connections 2020-01-26T15:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/1220899797 shutdown_connections 2020-01-26T15:21:45.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/1220899797 wait complete. 2020-01-26T15:21:45.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/1220899797 >> 172.21.15.129:0/1220899797 conn(0x7f4c34144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 Processor -- start 2020-01-26T15:21:45.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- - start start 2020-01-26T15:21:45.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c340a3b80 con 0 2020-01-26T15:21:45.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c340a67f0 con 0 2020-01-26T15:21:45.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c38d85700 1 -- 172.21.15.129:0/4083571477 learned_addr learned my addr 172.21.15.129:0/4083571477 2020-01-26T15:21:45.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c200020b0 con 0x7f4c340a61a0 2020-01-26T15:21:45.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3843766093 0 0) 0x7f4c200023f0 con 0x7f4c340a61a0 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4c1c002960 con 0 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c28003dd0 con 0x7f4c340a3190 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3995631063 0 0) 0x7f4c28003410 con 0x7f4c340a3190 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4c1c004620 con 0 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1476402862 0 0) 0x7f4c20000e50 con 0x7f4c340a61a0 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c1c002ee0 con 0 2020-01-26T15:21:45.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1289313510 0 0) 0x7f4c280038b0 con 0x7f4c340a3190 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4c1c003540 con 0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (81475109 0 0) 0x7f4c20001360 con 0x7f4c340a61a0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 >> 172.21.15.129:6789/0 conn(0x7f4c340a3190 :-1 s=STATE_OPEN pgs=43 cs=1 l=1).mark_down 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3407ab90 con 0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c340b2780 con 0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3418af20 con 0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4c20000bf0 con 0x7f4c340a61a0 2020-01-26T15:21:45.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.778 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4c20001790 con 0x7f4c340a61a0 2020-01-26T15:21:45.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.782 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f4c200033f0 con 0x7f4c340a61a0 2020-01-26T15:21:45.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.782 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f4c200036d0 con 0x7f4c340a61a0 2020-01-26T15:21:45.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.782 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3407af30 con 0 2020-01-26T15:21:45.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.786 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4c3407af30 con 0x7f4c340a61a0 2020-01-26T15:21:45.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.886 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c34073330 con 0 2020-01-26T15:21:45.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.886 7f4c31ffb700 1 -- 172.21.15.129:0/4083571477 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1195610651) 0x7f4c20002de0 con 0x7f4c340a61a0 2020-01-26T15:21:45.889 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:45.890 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":15,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:45.190225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:45.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 >> 172.21.15.129:6800/11038 conn(0x7f4c1c006e80 :-1 s=STATE_OPEN pgs=36 cs=1 l=1).mark_down 2020-01-26T15:21:45.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 >> 172.21.15.129:6791/0 conn(0x7f4c340a61a0 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:21:45.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 shutdown_connections 2020-01-26T15:21:45.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 shutdown_connections 2020-01-26T15:21:45.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 wait complete. 2020-01-26T15:21:45.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.890 7f4c3ad5f700 1 -- 172.21.15.129:0/4083571477 >> 172.21.15.129:0/4083571477 conn(0x7f4c34099340 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:45.901 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:42.851862', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:43.236142', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:45.901 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:45.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.990 7f476f82b700 1 Processor -- start 2020-01-26T15:21:45.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.990 7f476f82b700 1 -- - start start 2020-01-26T15:21:45.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.990 7f476f82b700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476814bb50 con 0 2020-01-26T15:21:45.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.990 7f476f82b700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476814bef0 con 0 2020-01-26T15:21:45.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.990 7f476d851700 1 -- 172.21.15.129:0/3264491246 learned_addr learned my addr 172.21.15.129:0/3264491246 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4760003930 con 0x7f4768148110 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3555690033 0 0) 0x7f4760003cb0 con 0x7f4768148110 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f474c002a20 con 0 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f47580022a0 con 0x7f476814b410 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4016574077 0 0) 0x7f47580025a0 con 0x7f476814b410 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f474c0046b0 con 0 2020-01-26T15:21:45.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3714637270 0 0) 0x7f4760004230 con 0x7f4768148110 2020-01-26T15:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 >> 172.21.15.129:6789/0 conn(0x7f476814b410 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476807a8b0 con 0 2020-01-26T15:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f47680ea030 con 0x7f4768148110 2020-01-26T15:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476c84f700 1 -- 172.21.15.129:0/3264491246 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4760001390 con 0x7f4768148110 2020-01-26T15:21:45.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476f82b700 1 -- 172.21.15.129:0/3264491246 >> 172.21.15.129:6790/0 conn(0x7f4768148110 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:21:45.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476f82b700 1 -- 172.21.15.129:0/3264491246 shutdown_connections 2020-01-26T15:21:45.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476f82b700 1 -- 172.21.15.129:0/3264491246 shutdown_connections 2020-01-26T15:21:45.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476f82b700 1 -- 172.21.15.129:0/3264491246 wait complete. 2020-01-26T15:21:45.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.994 7f476f82b700 1 -- 172.21.15.129:0/3264491246 >> 172.21.15.129:0/3264491246 conn(0x7f4768144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.001 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f476f82b700 1 Processor -- start 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f476f82b700 1 -- - start start 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f476f82b700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47680a3ce0 con 0 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f476f82b700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47680a6ab0 con 0 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f476d851700 1 -- 172.21.15.129:0/960909211 learned_addr learned my addr 172.21.15.129:0/960909211 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f47600011d0 con 0x7f47680a32f0 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4758002ae0 con 0x7f47680a6300 2020-01-26T15:21:46.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (87068471 0 0) 0x7f4760003680 con 0x7f47680a32f0 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4750002df0 con 0 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2807600062 0 0) 0x7f47580020e0 con 0x7f47680a6300 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4750004620 con 0 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4153636634 0 0) 0x7f4760003a50 con 0x7f47680a32f0 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4750004df0 con 0 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2816224692 0 0) 0x7f4758002470 con 0x7f47680a6300 2020-01-26T15:21:46.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4750006570 con 0 2020-01-26T15:21:46.004 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3056203158 0 0) 0x7f4760001b50 con 0x7f47680a32f0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 >> 172.21.15.129:6790/0 conn(0x7f47680a6300 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:45.998 7f475effd700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476807ab10 con 0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f476f82b700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47680711a0 con 0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f476f82b700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f476818b240 con 0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f47600016a0 con 0x7f47680a32f0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4760004510 con 0x7f47680a32f0 2020-01-26T15:21:46.005 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f4760004c70 con 0x7f47680a32f0 2020-01-26T15:21:46.006 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.002 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f47600065a0 con 0x7f47680a32f0 2020-01-26T15:21:46.009 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.006 7f476f82b700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476807ae90 con 0 2020-01-26T15:21:46.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.010 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f476807ae90 con 0x7f47680a32f0 2020-01-26T15:21:46.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.102 7f476f82b700 1 -- 172.21.15.129:0/960909211 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4768156410 con 0 2020-01-26T15:21:46.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.102 7f475effd700 1 -- 172.21.15.129:0/960909211 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v15) v1 ==== 92+0+10 (4292913633 0 265718887) 0x7f4760005110 con 0x7f47680a32f0 2020-01-26T15:21:46.105 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 >> 172.21.15.129:6800/11038 conn(0x7f47500072a0 :-1 s=STATE_OPEN pgs=37 cs=1 l=1).mark_down 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 >> 172.21.15.129:6789/0 conn(0x7f47680a32f0 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 shutdown_connections 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 shutdown_connections 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 wait complete. 2020-01-26T15:21:46.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.106 7f476f82b700 1 -- 172.21.15.129:0/960909211 >> 172.21.15.129:0/960909211 conn(0x7f4768099510 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.121 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 Processor -- start 2020-01-26T15:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- - start start 2020-01-26T15:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19014bb90 con 0 2020-01-26T15:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19014bf30 con 0 2020-01-26T15:21:46.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195a7a700 1 -- 172.21.15.129:0/675596140 learned_addr learned my addr 172.21.15.129:0/675596140 2020-01-26T15:21:46.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd180003630 con 0x7fd19014b400 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3520309004 0 0) 0x7fd1800039b0 con 0x7fd19014b400 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd178002a20 con 0 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd18c0022a0 con 0x7fd190148100 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2059113459 0 0) 0x7fd18c0025a0 con 0x7fd190148100 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd1780046c0 con 0 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3855647799 0 0) 0x7fd180003f80 con 0x7fd19014b400 2020-01-26T15:21:46.213 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 >> 172.21.15.129:6789/0 conn(0x7fd190148100 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:21:46.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19007a8a0 con 0 2020-01-26T15:21:46.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd190116eb0 con 0x7fd19014b400 2020-01-26T15:21:46.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd195279700 1 -- 172.21.15.129:0/675596140 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd180001050 con 0x7fd19014b400 2020-01-26T15:21:46.214 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- 172.21.15.129:0/675596140 >> 172.21.15.129:6790/0 conn(0x7fd19014b400 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:21:46.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- 172.21.15.129:0/675596140 shutdown_connections 2020-01-26T15:21:46.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- 172.21.15.129:0/675596140 shutdown_connections 2020-01-26T15:21:46.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- 172.21.15.129:0/675596140 wait complete. 2020-01-26T15:21:46.215 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.210 7fd198255700 1 -- 172.21.15.129:0/675596140 >> 172.21.15.129:0/675596140 conn(0x7fd190144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.217 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd198255700 1 Processor -- start 2020-01-26T15:21:46.217 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd198255700 1 -- - start start 2020-01-26T15:21:46.217 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd198255700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900a3dd0 con 0 2020-01-26T15:21:46.217 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd198255700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900a6910 con 0 2020-01-26T15:21:46.217 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd19627b700 1 -- 172.21.15.129:0/2833003343 learned_addr learned my addr 172.21.15.129:0/2833003343 2020-01-26T15:21:46.219 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd18c0020b0 con 0x7fd1900a3340 2020-01-26T15:21:46.219 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1808410640 0 0) 0x7fd18c002430 con 0x7fd1900a3340 2020-01-26T15:21:46.219 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd170002960 con 0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd180000e50 con 0x7fd1900a62c0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (841275053 0 0) 0x7fd180001570 con 0x7fd1900a62c0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fd170004620 con 0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3080019503 0 0) 0x7fd18c000e50 con 0x7fd1900a3340 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd170002ee0 con 0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.214 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4103110132 0 0) 0x7fd1800018f0 con 0x7fd1900a62c0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd170003540 con 0 2020-01-26T15:21:46.220 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3182183778 0 0) 0x7fd18c001540 con 0x7fd1900a3340 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 >> 172.21.15.129:6790/0 conn(0x7fd1900a62c0 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19007ab00 con 0 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd198255700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900b2700 con 0 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd198255700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19018b210 con 0 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fd18c000bf0 con 0x7fd1900a3340 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fd18c001b80 con 0x7fd1900a3340 2020-01-26T15:21:46.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fd18c0044b0 con 0x7fd1900a3340 2020-01-26T15:21:46.222 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.218 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fd18c0048d0 con 0x7fd1900a3340 2020-01-26T15:21:46.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.222 7fd198255700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19007ae80 con 0 2020-01-26T15:21:46.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.226 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fd19007ae80 con 0x7fd1900a3340 2020-01-26T15:21:46.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.318 7fd198255700 1 -- 172.21.15.129:0/2833003343 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fd190073250 con 0 2020-01-26T15:21:46.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd17f7fe700 1 -- 172.21.15.129:0/2833003343 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v15) v1 ==== 104+0+10 (3116399402 0 265718887) 0x7fd18c003f90 con 0x7fd1900a3340 2020-01-26T15:21:46.322 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:46.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 >> 172.21.15.129:6800/11038 conn(0x7fd170006ed0 :-1 s=STATE_OPEN pgs=38 cs=1 l=1).mark_down 2020-01-26T15:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 >> 172.21.15.129:6791/0 conn(0x7fd1900a3340 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 shutdown_connections 2020-01-26T15:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 shutdown_connections 2020-01-26T15:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 wait complete. 2020-01-26T15:21:46.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.322 7fd198255700 1 -- 172.21.15.129:0/2833003343 >> 172.21.15.129:0/2833003343 conn(0x7fd190099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.339 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:21:46.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.430 7f33afc48700 1 Processor -- start 2020-01-26T15:21:46.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.430 7f33afc48700 1 -- - start start 2020-01-26T15:21:46.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.430 7f33afc48700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a814bb50 con 0 2020-01-26T15:21:46.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.430 7f33afc48700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a814bef0 con 0 2020-01-26T15:21:46.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33adc6e700 1 -- 172.21.15.129:0/2497233311 learned_addr learned my addr 172.21.15.129:0/2497233311 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f33a4003630 con 0x7f33a8148110 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2622494520 0 0) 0x7f33a40039b0 con 0x7f33a8148110 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3390002a20 con 0 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f33980022a0 con 0x7f33a814b410 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3185072918 0 0) 0x7f3398002620 con 0x7f33a814b410 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f33900046c0 con 0 2020-01-26T15:21:46.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1699600807 0 0) 0x7f3398002ac0 con 0x7f33a814b410 2020-01-26T15:21:46.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 >> 172.21.15.129:6790/0 conn(0x7f33a8148110 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:21:46.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a807a8b0 con 0 2020-01-26T15:21:46.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f33a8116ec0 con 0x7f33a814b410 2020-01-26T15:21:46.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33acc6c700 1 -- 172.21.15.129:0/2497233311 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3398001010 con 0x7f33a814b410 2020-01-26T15:21:46.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33afc48700 1 -- 172.21.15.129:0/2497233311 >> 172.21.15.129:6789/0 conn(0x7f33a814b410 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:21:46.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33afc48700 1 -- 172.21.15.129:0/2497233311 shutdown_connections 2020-01-26T15:21:46.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33afc48700 1 -- 172.21.15.129:0/2497233311 shutdown_connections 2020-01-26T15:21:46.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33afc48700 1 -- 172.21.15.129:0/2497233311 wait complete. 2020-01-26T15:21:46.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.434 7f33afc48700 1 -- 172.21.15.129:0/2497233311 >> 172.21.15.129:0/2497233311 conn(0x7f33a8144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.440 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 Processor -- start 2020-01-26T15:21:46.440 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 -- - start start 2020-01-26T15:21:46.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a80a3ca0 con 0 2020-01-26T15:21:46.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a80a5150 con 0 2020-01-26T15:21:46.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33adc6e700 1 -- 172.21.15.129:0/4243105797 learned_addr learned my addr 172.21.15.129:0/4243105797 2020-01-26T15:21:46.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f33a4003440 con 0x7f33a80a33a0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (793557080 0 0) 0x7f33a4003740 con 0x7f33a80a33a0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3388002960 con 0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3398000e50 con 0x7f33a8095be0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1928872584 0 0) 0x7f3398002080 con 0x7f33a8095be0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3388004620 con 0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2075032322 0 0) 0x7f33a4000e50 con 0x7f33a80a33a0 2020-01-26T15:21:46.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3388002ee0 con 0 2020-01-26T15:21:46.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2992691528 0 0) 0x7f3398002400 con 0x7f33a8095be0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3388003540 con 0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3858655127 0 0) 0x7f33a4001360 con 0x7f33a80a33a0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 >> 172.21.15.129:6789/0 conn(0x7f33a8095be0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a807ab10 con 0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a80b26e0 con 0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f33afc48700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80a69c0 con 0 2020-01-26T15:21:46.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f33a4000bf0 con 0x7f33a80a33a0 2020-01-26T15:21:46.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.438 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f33a4001790 con 0x7f33a80a33a0 2020-01-26T15:21:46.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.442 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f33a40019d0 con 0x7f33a80a33a0 2020-01-26T15:21:46.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.442 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f33a4005d80 con 0x7f33a80a33a0 2020-01-26T15:21:46.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.446 7f33afc48700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3384002070 con 0 2020-01-26T15:21:46.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.450 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f33a4004470 con 0x7f33a80a33a0 2020-01-26T15:21:46.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.538 7f33afc48700 1 -- 172.21.15.129:0/4243105797 --> 172.21.15.129:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f33840012a0 con 0 2020-01-26T15:21:46.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f3396ffd700 1 -- 172.21.15.129:0/4243105797 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v15) v1 ==== 100+0+10 (3921105427 0 265718887) 0x7f33a4004750 con 0x7f33a80a33a0 2020-01-26T15:21:46.543 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:46.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 >> 172.21.15.129:6800/11038 conn(0x7f3388006e70 :-1 s=STATE_OPEN pgs=39 cs=1 l=1).mark_down 2020-01-26T15:21:46.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 >> 172.21.15.129:6790/0 conn(0x7f33a80a33a0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:21:46.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 shutdown_connections 2020-01-26T15:21:46.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 shutdown_connections 2020-01-26T15:21:46.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 wait complete. 2020-01-26T15:21:46.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.542 7f33afc48700 1 -- 172.21.15.129:0/4243105797 >> 172.21.15.129:0/4243105797 conn(0x7f33a80994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.554 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:21:46.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:21:46.554 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:21:46.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6df0f0c700 1 Processor -- start 2020-01-26T15:21:46.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6df0f0c700 1 -- - start start 2020-01-26T15:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6df0f0c700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec14bb10 con 0 2020-01-26T15:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6df0f0c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec14beb0 con 0 2020-01-26T15:21:46.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6dea570700 1 -- 172.21.15.129:0/2627769092 learned_addr learned my addr 172.21.15.129:0/2627769092 2020-01-26T15:21:46.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6de0003630 con 0x7f6dec14b3d0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (190503071 0 0) 0x7f6de00039b0 con 0x7f6dec14b3d0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dd0002a20 con 0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ddc0022a0 con 0x7f6dec1480d0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4285948807 0 0) 0x7f6ddc002620 con 0x7f6dec1480d0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.646 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dd00046c0 con 0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2728279653 0 0) 0x7f6ddc002ac0 con 0x7f6dec1480d0 2020-01-26T15:21:46.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 >> 172.21.15.129:6791/0 conn(0x7f6dec14b3d0 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:21:46.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec07a930 con 0 2020-01-26T15:21:46.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6dec0e9ff0 con 0x7f6dec1480d0 2020-01-26T15:21:46.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6de9d6f700 1 -- 172.21.15.129:0/2627769092 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ddc001010 con 0x7f6dec1480d0 2020-01-26T15:21:46.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6df0f0c700 1 -- 172.21.15.129:0/2627769092 >> 172.21.15.129:6789/0 conn(0x7f6dec1480d0 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6df0f0c700 1 -- 172.21.15.129:0/2627769092 shutdown_connections 2020-01-26T15:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6df0f0c700 1 -- 172.21.15.129:0/2627769092 shutdown_connections 2020-01-26T15:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6df0f0c700 1 -- 172.21.15.129:0/2627769092 wait complete. 2020-01-26T15:21:46.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.650 7f6df0f0c700 1 -- 172.21.15.129:0/2627769092 >> 172.21.15.129:0/2627769092 conn(0x7f6dec144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 Processor -- start 2020-01-26T15:21:46.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 -- - start start 2020-01-26T15:21:46.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec0a3e90 con 0 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec0a5250 con 0 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6dead71700 1 -- 172.21.15.129:0/4114445334 learned_addr learned my addr 172.21.15.129:0/4114445334 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ddc001010 con 0x7f6dec0a34a0 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6de0003f50 con 0x7f6dec095cf0 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2821235912 0 0) 0x7f6ddc002080 con 0x7f6dec0a34a0 2020-01-26T15:21:46.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc8002df0 con 0 2020-01-26T15:21:46.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (860252582 0 0) 0x7f6de0003470 con 0x7f6dec095cf0 2020-01-26T15:21:46.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6dc8004620 con 0 2020-01-26T15:21:46.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2084600682 0 0) 0x7f6ddc0024e0 con 0x7f6dec0a34a0 2020-01-26T15:21:46.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6dc8004df0 con 0 2020-01-26T15:21:46.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4057475789 0 0) 0x7f6de0003800 con 0x7f6dec095cf0 2020-01-26T15:21:46.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6dc8006570 con 0 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3608281266 0 0) 0x7f6de00010f0 con 0x7f6dec095cf0 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 >> 172.21.15.129:6789/0 conn(0x7f6dec0a34a0 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec07ab90 con 0 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec0b27f0 con 0 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0a6950 con 0 2020-01-26T15:21:46.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6dec116e80 con 0x7f6dec095cf0 2020-01-26T15:21:46.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6de0001520 con 0x7f6dec095cf0 2020-01-26T15:21:46.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f6de0004260 con 0x7f6dec095cf0 2020-01-26T15:21:46.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.654 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f6de0005af0 con 0x7f6dec095cf0 2020-01-26T15:21:46.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.658 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec07af30 con 0 2020-01-26T15:21:46.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.662 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6dec07af30 con 0x7f6dec095cf0 2020-01-26T15:21:46.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6dec073330 con 0 2020-01-26T15:21:46.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6ddbfff700 1 -- 172.21.15.129:0/4114445334 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+1889 (289213126 0 605182923) 0x7f6de0001760 con 0x7f6dec095cf0 2020-01-26T15:21:46.753 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:46.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 >> 172.21.15.129:6800/11038 conn(0x7f6dc80072a0 :-1 s=STATE_OPEN pgs=40 cs=1 l=1).mark_down 2020-01-26T15:21:46.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 >> 172.21.15.129:6791/0 conn(0x7f6dec095cf0 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:21:46.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 shutdown_connections 2020-01-26T15:21:46.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.750 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 shutdown_connections 2020-01-26T15:21:46.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.754 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 wait complete. 2020-01-26T15:21:46.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.754 7f6df0f0c700 1 -- 172.21.15.129:0/4114445334 >> 172.21.15.129:0/4114445334 conn(0x7f6dec099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.769 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addr":"172.21.15.129:6800/11038","available":true,"standbys":[{"gid":4103,"name":"y","available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"balancer","can_run":true,"error_string":""},{"name":"crash","can_run":true,"error_string":""},{"name":"dashboard","can_run":true,"error_string":""},{"name":"hello","can_run":true,"error_string":""},{"name":"influx","can_run":false,"error_string":"influxdb python module not found"},{"name":"iostat","can_run":true,"error_string":""},{"name":"localpool","can_run":true,"error_string":""},{"name":"prometheus","can_run":true,"error_string":""},{"name":"restful","can_run":true,"error_string":""},{"name":"selftest","can_run":true,"error_string":""},{"name":"smart","can_run":true,"error_string":""},{"name":"status","can_run":true,"error_string":""},{"name":"telegraf","can_run":true,"error_string":""},{"name":"telemetry","can_run":true,"error_string":""},{"name":"zabbix","can_run":true,"error_string":""}],"services":{}} 2020-01-26T15:21:46.769 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:21:46.769 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:21:46.770 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:46.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda6d883700 1 Processor -- start 2020-01-26T15:21:46.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda6d883700 1 -- - start start 2020-01-26T15:21:46.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda6d883700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6814bb10 con 0 2020-01-26T15:21:46.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda6d883700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6814beb0 con 0 2020-01-26T15:21:46.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda677fe700 1 -- 172.21.15.129:0/3810731807 learned_addr learned my addr 172.21.15.129:0/3810731807 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda580039b0 con 0x7fda681480d0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4036898749 0 0) 0x7fda58003d30 con 0x7fda681480d0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fda54002a20 con 0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda5c0022a0 con 0x7fda6814b3d0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (83234546 0 0) 0x7fda5c0025a0 con 0x7fda6814b3d0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fda540046c0 con 0 2020-01-26T15:21:46.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (650017122 0 0) 0x7fda58004300 con 0x7fda681480d0 2020-01-26T15:21:46.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 >> 172.21.15.129:6789/0 conn(0x7fda6814b3d0 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:21:46.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.858 7fda667fc700 1 -- 172.21.15.129:0/3810731807 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6807a930 con 0 2020-01-26T15:21:46.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fda680e9ff0 con 0x7fda681480d0 2020-01-26T15:21:46.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda667fc700 1 -- 172.21.15.129:0/3810731807 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda580013d0 con 0x7fda681480d0 2020-01-26T15:21:46.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 -- 172.21.15.129:0/3810731807 >> 172.21.15.129:6790/0 conn(0x7fda681480d0 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:21:46.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 -- 172.21.15.129:0/3810731807 shutdown_connections 2020-01-26T15:21:46.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 -- 172.21.15.129:0/3810731807 shutdown_connections 2020-01-26T15:21:46.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 -- 172.21.15.129:0/3810731807 wait complete. 2020-01-26T15:21:46.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 -- 172.21.15.129:0/3810731807 >> 172.21.15.129:0/3810731807 conn(0x7fda68144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.862 7fda6d883700 1 Processor -- start 2020-01-26T15:21:46.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda6d883700 1 -- - start start 2020-01-26T15:21:46.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda6d883700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680a3dd0 con 0 2020-01-26T15:21:46.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda6d883700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680a6b10 con 0 2020-01-26T15:21:46.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda66ffd700 1 -- 172.21.15.129:0/3350676242 learned_addr learned my addr 172.21.15.129:0/3350676242 2020-01-26T15:21:46.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda580011d0 con 0x7fda680a33e0 2020-01-26T15:21:46.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4200629514 0 0) 0x7fda580018f0 con 0x7fda680a33e0 2020-01-26T15:21:46.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fda48002960 con 0 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda5c0020b0 con 0x7fda680a6360 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (721580096 0 0) 0x7fda5c002430 con 0x7fda680a6360 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fda48004620 con 0 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1189046574 0 0) 0x7fda58001d40 con 0x7fda680a33e0 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fda48002ee0 con 0 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1987685374 0 0) 0x7fda580039a0 con 0x7fda680a33e0 2020-01-26T15:21:46.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 >> 172.21.15.129:6790/0 conn(0x7fda680a6360 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6807ab90 con 0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda6d883700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680b2780 con 0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fda580016e0 con 0x7fda680a33e0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda6d883700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6818b1e0 con 0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fda58003dd0 con 0x7fda680a33e0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fda58004d10 con 0x7fda680a33e0 2020-01-26T15:21:46.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.866 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fda58006730 con 0x7fda680a33e0 2020-01-26T15:21:46.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.874 7fda6d883700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6807af30 con 0 2020-01-26T15:21:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.878 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fda6807af30 con 0x7fda680a33e0 2020-01-26T15:21:46.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.970 7fda6d883700 1 -- 172.21.15.129:0/3350676242 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda6818b9e0 con 0 2020-01-26T15:21:46.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda64ff9700 1 -- 172.21.15.129:0/3350676242 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1195610651) 0x7fda58004890 con 0x7fda680a33e0 2020-01-26T15:21:46.975 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:46.975 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":15,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:45.190225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:46.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 >> 172.21.15.129:6800/11038 conn(0x7fda48006650 :-1 s=STATE_OPEN pgs=44 cs=1 l=1).mark_down 2020-01-26T15:21:46.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 >> 172.21.15.129:6789/0 conn(0x7fda680a33e0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:21:46.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 shutdown_connections 2020-01-26T15:21:46.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 shutdown_connections 2020-01-26T15:21:46.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 wait complete. 2020-01-26T15:21:46.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:46.974 7fda6d883700 1 -- 172.21.15.129:0/3350676242 >> 172.21.15.129:0/3350676242 conn(0x7fda68099550 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:46.985 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:21:46.986 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:47.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad866d700 1 Processor -- start 2020-01-26T15:21:47.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad866d700 1 -- - start start 2020-01-26T15:21:47.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad866d700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad014bb10 con 0 2020-01-26T15:21:47.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad866d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad014beb0 con 0 2020-01-26T15:21:47.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5e92700 1 -- 172.21.15.129:0/959501506 learned_addr learned my addr 172.21.15.129:0/959501506 2020-01-26T15:21:47.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1ac0003630 con 0x7f1ad014b3d0 2020-01-26T15:21:47.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2743794968 0 0) 0x7f1ac00039b0 con 0x7f1ad014b3d0 2020-01-26T15:21:47.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ab8002a20 con 0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1acc002620 con 0x7f1ad01480d0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1960585512 0 0) 0x7f1acc002920 con 0x7f1ad01480d0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ab80046b0 con 0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2422077642 0 0) 0x7f1ac0003f80 con 0x7f1ad014b3d0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 >> 172.21.15.129:6791/0 conn(0x7f1ad01480d0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad007a930 con 0 2020-01-26T15:21:47.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1ad0116e80 con 0x7f1ad014b3d0 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad5691700 1 -- 172.21.15.129:0/959501506 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1ac0001050 con 0x7f1ad014b3d0 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.078 7f1ad866d700 1 -- 172.21.15.129:0/959501506 >> 172.21.15.129:6789/0 conn(0x7f1ad014b3d0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- 172.21.15.129:0/959501506 shutdown_connections 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- 172.21.15.129:0/959501506 shutdown_connections 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- 172.21.15.129:0/959501506 wait complete. 2020-01-26T15:21:47.084 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- 172.21.15.129:0/959501506 >> 172.21.15.129:0/959501506 conn(0x7f1ad0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 Processor -- start 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- - start start 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00a3eb0 con 0 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad866d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00a53d0 con 0 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1ad6693700 1 -- 172.21.15.129:0/2836683400 learned_addr learned my addr 172.21.15.129:0/2836683400 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1ac0000e50 con 0x7f1ad0095d00 2020-01-26T15:21:47.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (137446239 0 0) 0x7f1ac0003380 con 0x7f1ad0095d00 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ab0002960 con 0 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1acc002460 con 0x7f1ad00a34c0 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (929983741 0 0) 0x7f1acc002760 con 0x7f1ad00a34c0 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1ab0004620 con 0 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4181368 0 0) 0x7f1ac00037d0 con 0x7f1ad0095d00 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ab0002ee0 con 0 2020-01-26T15:21:47.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1284020696 0 0) 0x7f1acc0011d0 con 0x7f1ad00a34c0 2020-01-26T15:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.082 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ab0003540 con 0 2020-01-26T15:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1665654336 0 0) 0x7f1acc001710 con 0x7f1ad00a34c0 2020-01-26T15:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 >> 172.21.15.129:6789/0 conn(0x7f1ad0095d00 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad007ab90 con 0 2020-01-26T15:21:47.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad00712f0 con 0 2020-01-26T15:21:47.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad00a6d00 con 0 2020-01-26T15:21:47.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1acc000f70 con 0x7f1ad00a34c0 2020-01-26T15:21:47.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1acc001980 con 0x7f1ad00a34c0 2020-01-26T15:21:47.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f1acc004310 con 0x7f1ad00a34c0 2020-01-26T15:21:47.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.086 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f1acc001bc0 con 0x7f1ad00a34c0 2020-01-26T15:21:47.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.090 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad007af30 con 0 2020-01-26T15:21:47.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.098 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1ad007af30 con 0x7f1ad00a34c0 2020-01-26T15:21:47.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.186 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad01563d0 con 0 2020-01-26T15:21:47.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1abf7fe700 1 -- 172.21.15.129:0/2836683400 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1195610651) 0x7f1acc004a80 con 0x7f1ad00a34c0 2020-01-26T15:21:47.191 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:47.191 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":15,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:45.190225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 >> 172.21.15.129:6800/11038 conn(0x7f1ab0006ed0 :-1 s=STATE_OPEN pgs=45 cs=1 l=1).mark_down 2020-01-26T15:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 >> 172.21.15.129:6791/0 conn(0x7f1ad00a34c0 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:21:47.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 shutdown_connections 2020-01-26T15:21:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 shutdown_connections 2020-01-26T15:21:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 wait complete. 2020-01-26T15:21:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.190 7f1ad866d700 1 -- 172.21.15.129:0/2836683400 >> 172.21.15.129:0/2836683400 conn(0x7f1ad0099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.202 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:21:47.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.290 7fa260f18700 1 Processor -- start 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.290 7fa260f18700 1 -- - start start 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.290 7fa260f18700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c14bb30 con 0 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.290 7fa260f18700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c14bed0 con 0 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.290 7fa25a570700 1 -- 172.21.15.129:0/1247018481 learned_addr learned my addr 172.21.15.129:0/1247018481 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa250003630 con 0x7fa25c14b3f0 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa24c0022a0 con 0x7fa25c1480f0 2020-01-26T15:21:47.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1043421155 0 0) 0x7fa2500039b0 con 0x7fa25c14b3f0 2020-01-26T15:21:47.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa240002ea0 con 0 2020-01-26T15:21:47.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2141089001 0 0) 0x7fa24c002620 con 0x7fa25c1480f0 2020-01-26T15:21:47.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2400046b0 con 0 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1362958352 0 0) 0x7fa24c002ac0 con 0x7fa25c1480f0 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 >> 172.21.15.129:6791/0 conn(0x7fa25c14b3f0 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c07a890 con 0 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa25c0ea010 con 0x7fa25c1480f0 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa259d6f700 1 -- 172.21.15.129:0/1247018481 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa24c001010 con 0x7fa25c1480f0 2020-01-26T15:21:47.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa260f18700 1 -- 172.21.15.129:0/1247018481 >> 172.21.15.129:6790/0 conn(0x7fa25c1480f0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:21:47.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa260f18700 1 -- 172.21.15.129:0/1247018481 shutdown_connections 2020-01-26T15:21:47.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa260f18700 1 -- 172.21.15.129:0/1247018481 shutdown_connections 2020-01-26T15:21:47.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa260f18700 1 -- 172.21.15.129:0/1247018481 wait complete. 2020-01-26T15:21:47.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.294 7fa260f18700 1 -- 172.21.15.129:0/1247018481 >> 172.21.15.129:0/1247018481 conn(0x7fa25c144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 Processor -- start 2020-01-26T15:21:47.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 -- - start start 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0a3c30 con 0 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0a68a0 con 0 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa25ad71700 1 -- 172.21.15.129:0/780740445 learned_addr learned my addr 172.21.15.129:0/780740445 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa24c001010 con 0x7fa25c0a3240 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1762389991 0 0) 0x7fa24c0020b0 con 0x7fa25c0a3240 2020-01-26T15:21:47.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa238002960 con 0 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa250003f40 con 0x7fa25c0a6250 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4293860243 0 0) 0x7fa250003470 con 0x7fa25c0a6250 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa238004620 con 0 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2709183506 0 0) 0x7fa24c002620 con 0x7fa25c0a3240 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa238002ee0 con 0 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2857490488 0 0) 0x7fa2500038d0 con 0x7fa25c0a6250 2020-01-26T15:21:47.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa238003540 con 0 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1295835824 0 0) 0x7fa24c001950 con 0x7fa25c0a3240 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 >> 172.21.15.129:6789/0 conn(0x7fa25c0a6250 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c07aaf0 con 0 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c0b25f0 con 0 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa260f18700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c18b0b0 con 0 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa24c000bf0 con 0x7fa25c0a3240 2020-01-26T15:21:47.316 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa24c002ed0 con 0x7fa25c0a3240 2020-01-26T15:21:47.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa24c003630 con 0x7fa25c0a3240 2020-01-26T15:21:47.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.298 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fa24c006370 con 0x7fa25c0a3240 2020-01-26T15:21:47.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.302 7fa260f18700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6809/11408 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa23c004d60 con 0 2020-01-26T15:21:47.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.306 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== osd.0 172.21.15.129:6809/11408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7fa254000f70 con 0x7fa23c001600 2020-01-26T15:21:47.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.314 7fa260f18700 1 -- 172.21.15.129:0/780740445 --> 172.21.15.129:6809/11408 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa23c0053e0 con 0 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa24bfff700 1 -- 172.21.15.129:0/780740445 <== osd.0 172.21.15.129:6809/11408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7fa23c004d60 con 0x7fa23c001600 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 >> 172.21.15.129:6809/11408 conn(0x7fa23c001600 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 >> 172.21.15.129:6800/11038 conn(0x7fa238006e70 :-1 s=STATE_OPEN pgs=46 cs=1 l=1).mark_down 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 >> 172.21.15.129:6791/0 conn(0x7fa25c0a3240 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 shutdown_connections 2020-01-26T15:21:47.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 shutdown_connections 2020-01-26T15:21:47.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 wait complete. 2020-01-26T15:21:47.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.318 7fa260f18700 1 -- 172.21.15.129:0/780740445 >> 172.21.15.129:0/780740445 conn(0x7fa25c099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.326 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:47.335 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:21:47.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.426 7f75d0782700 1 Processor -- start 2020-01-26T15:21:47.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.426 7f75d0782700 1 -- - start start 2020-01-26T15:21:47.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c814bb30 con 0 2020-01-26T15:21:47.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c814bed0 con 0 2020-01-26T15:21:47.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75ce7a8700 1 -- 172.21.15.129:0/18404938 learned_addr learned my addr 172.21.15.129:0/18404938 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75b80022a0 con 0x7f75c814b3f0 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2276223490 0 0) 0x7f75b8002620 con 0x7f75c814b3f0 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75b0002a20 con 0 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75c40039b0 con 0x7f75c81480f0 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (856789893 0 0) 0x7f75c4003d30 con 0x7f75c81480f0 2020-01-26T15:21:47.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75b00046c0 con 0 2020-01-26T15:21:47.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4009472169 0 0) 0x7f75b8002bf0 con 0x7f75c814b3f0 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 >> 172.21.15.129:6791/0 conn(0x7f75c81480f0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c807a890 con 0 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f75c8116ea0 con 0x7f75c814b3f0 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75cd7a6700 1 -- 172.21.15.129:0/18404938 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75b8001050 con 0x7f75c814b3f0 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- 172.21.15.129:0/18404938 >> 172.21.15.129:6789/0 conn(0x7f75c814b3f0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:21:47.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- 172.21.15.129:0/18404938 shutdown_connections 2020-01-26T15:21:47.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- 172.21.15.129:0/18404938 shutdown_connections 2020-01-26T15:21:47.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- 172.21.15.129:0/18404938 wait complete. 2020-01-26T15:21:47.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.430 7f75d0782700 1 -- 172.21.15.129:0/18404938 >> 172.21.15.129:0/18404938 conn(0x7f75c8144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75d0782700 1 Processor -- start 2020-01-26T15:21:47.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75d0782700 1 -- - start start 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75d0782700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80a3ba0 con 0 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75d0782700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80a6970 con 0 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75ce7a8700 1 -- 172.21.15.129:0/1280456381 learned_addr learned my addr 172.21.15.129:0/1280456381 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75c40037c0 con 0x7f75c80a31b0 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75b8000e50 con 0x7f75c80a61c0 2020-01-26T15:21:47.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3931216169 0 0) 0x7f75c40040c0 con 0x7f75c80a31b0 2020-01-26T15:21:47.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75a8002df0 con 0 2020-01-26T15:21:47.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1802988200 0 0) 0x7f75b8001ff0 con 0x7f75c80a61c0 2020-01-26T15:21:47.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f75a8004620 con 0 2020-01-26T15:21:47.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.434 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (392818271 0 0) 0x7f75c40011d0 con 0x7f75c80a31b0 2020-01-26T15:21:47.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75a8004df0 con 0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2354800859 0 0) 0x7f75b8002370 con 0x7f75c80a61c0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75a8006570 con 0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (464068708 0 0) 0x7f75c40016e0 con 0x7f75c80a31b0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 >> 172.21.15.129:6790/0 conn(0x7f75c80a61c0 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c807aaf0 con 0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75d0782700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c80b25b0 con 0 2020-01-26T15:21:47.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f75c4000f70 con 0x7f75c80a31b0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75d0782700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c818b100 con 0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f75c4001b10 con 0x7f75c80a31b0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f75c4004b00 con 0x7f75c80a31b0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.438 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f75c4006390 con 0x7f75c80a31b0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.442 7f75d0782700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6801/11406 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75c8148880 con 0 2020-01-26T15:21:47.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.442 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== osd.1 172.21.15.129:6801/11406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f75c0000bf0 con 0x7f75c8034260 2020-01-26T15:21:47.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 --> 172.21.15.129:6801/11406 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75c807ae70 con 0 2020-01-26T15:21:47.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75b77fe700 1 -- 172.21.15.129:0/1280456381 <== osd.1 172.21.15.129:6801/11406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f75c8148880 con 0x7f75c8034260 2020-01-26T15:21:47.456 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:47.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 >> 172.21.15.129:6801/11406 conn(0x7f75c8034260 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-01-26T15:21:47.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 >> 172.21.15.129:6800/11038 conn(0x7f75a80072a0 :-1 s=STATE_OPEN pgs=47 cs=1 l=1).mark_down 2020-01-26T15:21:47.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 >> 172.21.15.129:6791/0 conn(0x7f75c80a31b0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:21:47.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 shutdown_connections 2020-01-26T15:21:47.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 shutdown_connections 2020-01-26T15:21:47.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 wait complete. 2020-01-26T15:21:47.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.454 7f75d0782700 1 -- 172.21.15.129:0/1280456381 >> 172.21.15.129:0/1280456381 conn(0x7f75c80992e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.469 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602c42a700 1 Processor -- start 2020-01-26T15:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602c42a700 1 -- - start start 2020-01-26T15:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602c42a700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602414bb30 con 0 2020-01-26T15:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602c42a700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602414bed0 con 0 2020-01-26T15:21:47.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602a450700 1 -- 172.21.15.129:0/3167812818 learned_addr learned my addr 172.21.15.129:0/3167812818 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f601c0039b0 con 0x7f60241480f0 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1761688226 0 0) 0x7f601c003d30 con 0x7f60241480f0 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6010002a20 con 0 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f60180022a0 con 0x7f602414b3f0 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4017569915 0 0) 0x7f60180025a0 con 0x7f602414b3f0 2020-01-26T15:21:47.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f60100046c0 con 0 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (771879058 0 0) 0x7f601c004300 con 0x7f60241480f0 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 >> 172.21.15.129:6790/0 conn(0x7f602414b3f0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602407a890 con 0 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f601c000f70 con 0x7f60241480f0 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602944e700 1 -- 172.21.15.129:0/3167812818 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f601c0013d0 con 0x7f60241480f0 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.566 7f602c42a700 1 -- 172.21.15.129:0/3167812818 >> 172.21.15.129:6791/0 conn(0x7f60241480f0 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- 172.21.15.129:0/3167812818 shutdown_connections 2020-01-26T15:21:47.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- 172.21.15.129:0/3167812818 shutdown_connections 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- 172.21.15.129:0/3167812818 wait complete. 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- 172.21.15.129:0/3167812818 >> 172.21.15.129:0/3167812818 conn(0x7f6024144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 Processor -- start 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- - start start 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240a3da0 con 0 2020-01-26T15:21:47.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f602c42a700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240a33b0 con 0 2020-01-26T15:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f6029c4f700 1 -- 172.21.15.129:0/901882244 learned_addr learned my addr 172.21.15.129:0/901882244 2020-01-26T15:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f60180020e0 con 0x7f60240a5160 2020-01-26T15:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f601c004300 con 0x7f6024095c70 2020-01-26T15:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1177209947 0 0) 0x7f601c001250 con 0x7f6024095c70 2020-01-26T15:21:47.585 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6004002df0 con 0 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1519318101 0 0) 0x7f60180023e0 con 0x7f60240a5160 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6004004620 con 0 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2234746839 0 0) 0x7f6018000e50 con 0x7f60240a5160 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6004004df0 con 0 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2137098648 0 0) 0x7f601c003820 con 0x7f6024095c70 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6004006570 con 0 2020-01-26T15:21:47.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3169386033 0 0) 0x7f60180013c0 con 0x7f60240a5160 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.570 7f60237fe700 1 -- 172.21.15.129:0/901882244 >> 172.21.15.129:6789/0 conn(0x7f6024095c70 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f60237fe700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602407aaf0 con 0 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f602c42a700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240b2780 con 0 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f602c42a700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240a6aa0 con 0 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6024116ea0 con 0x7f60240a5160 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f60180017f0 con 0x7f60240a5160 2020-01-26T15:21:47.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f6018001af0 con 0x7f60240a5160 2020-01-26T15:21:47.588 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.574 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f6018005c40 con 0x7f60240a5160 2020-01-26T15:21:47.588 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.578 7f602c42a700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6813/11410 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6000004d60 con 0 2020-01-26T15:21:47.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.582 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== osd.2 172.21.15.129:6813/11410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f60240bd1d0 con 0x7f6000001600 2020-01-26T15:21:47.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 --> 172.21.15.129:6813/11410 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60000053e0 con 0 2020-01-26T15:21:47.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f60237fe700 1 -- 172.21.15.129:0/901882244 <== osd.2 172.21.15.129:6813/11410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f6000004d60 con 0x7f6000001600 2020-01-26T15:21:47.593 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:47.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 >> 172.21.15.129:6813/11410 conn(0x7f6000001600 :-1 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down 2020-01-26T15:21:47.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 >> 172.21.15.129:6800/11038 conn(0x7f60040072a0 :-1 s=STATE_OPEN pgs=48 cs=1 l=1).mark_down 2020-01-26T15:21:47.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 >> 172.21.15.129:6790/0 conn(0x7f60240a5160 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:21:47.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 shutdown_connections 2020-01-26T15:21:47.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 shutdown_connections 2020-01-26T15:21:47.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.590 7f602c42a700 1 -- 172.21.15.129:0/901882244 wait complete. 2020-01-26T15:21:47.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.594 7f602c42a700 1 -- 172.21.15.129:0/901882244 >> 172.21.15.129:0/901882244 conn(0x7f6024099540 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.606 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 Processor -- start 2020-01-26T15:21:47.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 -- - start start 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc14bb80 con 0 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc14bf20 con 0 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfb7fe700 1 -- 172.21.15.129:0/1247755106 learned_addr learned my addr 172.21.15.129:0/1247755106 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3df0002620 con 0x7f3dfc14b3f0 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1703661751 0 0) 0x7f3df00029a0 con 0x7f3dfc14b3f0 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3de8002a20 con 0 2020-01-26T15:21:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3dec003630 con 0x7f3dfc1480f0 2020-01-26T15:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (473505766 0 0) 0x7f3dec0039b0 con 0x7f3dfc1480f0 2020-01-26T15:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3de80046c0 con 0 2020-01-26T15:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4113672350 0 0) 0x7f3df0002f70 con 0x7f3dfc14b3f0 2020-01-26T15:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 >> 172.21.15.129:6791/0 conn(0x7f3dfc1480f0 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:21:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc07a890 con 0 2020-01-26T15:21:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3df0000f70 con 0x7f3dfc14b3f0 2020-01-26T15:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 -- 172.21.15.129:0/1247755106 >> 172.21.15.129:6790/0 conn(0x7f3dfc14b3f0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:21:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3dfa7fc700 1 -- 172.21.15.129:0/1247755106 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3df00013d0 con 0x7f3dfc14b3f0 2020-01-26T15:21:47.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.706 7f3e01b85700 1 -- 172.21.15.129:0/1247755106 shutdown_connections 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- 172.21.15.129:0/1247755106 shutdown_connections 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- 172.21.15.129:0/1247755106 wait complete. 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- 172.21.15.129:0/1247755106 >> 172.21.15.129:0/1247755106 conn(0x7f3dfc144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 Processor -- start 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- - start start 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0a3dd0 con 0 2020-01-26T15:21:47.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3e01b85700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0a3390 con 0 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3dfaffd700 1 -- 172.21.15.129:0/3436812607 learned_addr learned my addr 172.21.15.129:0/3436812607 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3df00011d0 con 0x7f3dfc0a5140 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1168559851 0 0) 0x7f3df0002370 con 0x7f3dfc0a5140 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ddc002960 con 0 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3dec003470 con 0x7f3dfc095c90 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2919914166 0 0) 0x7f3dec003d40 con 0x7f3dfc095c90 2020-01-26T15:21:47.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ddc004620 con 0 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (379105796 0 0) 0x7f3df00026f0 con 0x7f3dfc0a5140 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ddc002ee0 con 0 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (981354128 0 0) 0x7f3dec003fb0 con 0x7f3dfc095c90 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.710 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ddc003540 con 0 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1022568438 0 0) 0x7f3df0001b90 con 0x7f3dfc0a5140 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 >> 172.21.15.129:6789/0 conn(0x7f3dfc095c90 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:21:47.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc07aaf0 con 0 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc0b2780 con 0 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc0a6bc0 con 0 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3df00016e0 con 0x7f3dfc0a5140 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3df0001e00 con 0x7f3dfc0a5140 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f3df0003950 con 0x7f3dfc0a5140 2020-01-26T15:21:47.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.714 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f3df0003f50 con 0x7f3dfc0a5140 2020-01-26T15:21:47.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.718 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6805/11407 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3dfc148880 con 0 2020-01-26T15:21:47.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.722 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== osd.3 172.21.15.129:6805/11407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (0 0 1906538568) 0x7f3df4000bf0 con 0x7f3dfc033d50 2020-01-26T15:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 --> 172.21.15.129:6805/11407 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3dfc07ae70 con 0 2020-01-26T15:21:47.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3df8ff9700 1 -- 172.21.15.129:0/3436812607 <== osd.3 172.21.15.129:6805/11407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (0 0 2374206864) 0x7f3dfc148880 con 0x7f3dfc033d50 2020-01-26T15:21:47.737 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:47.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 >> 172.21.15.129:6805/11407 conn(0x7f3dfc033d50 :-1 s=STATE_OPEN pgs=7 cs=1 l=1).mark_down 2020-01-26T15:21:47.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 >> 172.21.15.129:6800/11038 conn(0x7f3ddc006e70 :-1 s=STATE_OPEN pgs=49 cs=1 l=1).mark_down 2020-01-26T15:21:47.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 >> 172.21.15.129:6790/0 conn(0x7f3dfc0a5140 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:21:47.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.734 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 shutdown_connections 2020-01-26T15:21:47.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.738 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 shutdown_connections 2020-01-26T15:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.738 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 wait complete. 2020-01-26T15:21:47.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.738 7f3e01b85700 1 -- 172.21.15.129:0/3436812607 >> 172.21.15.129:0/3436812607 conn(0x7f3dfc099540 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.753 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:21:47.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cc0da6700 1 Processor -- start 2020-01-26T15:21:47.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cc0da6700 1 -- - start start 2020-01-26T15:21:47.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cc0da6700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc14bb30 con 0 2020-01-26T15:21:47.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cc0da6700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc14bed0 con 0 2020-01-26T15:21:47.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cbad71700 1 -- 172.21.15.129:0/370045237 learned_addr learned my addr 172.21.15.129:0/370045237 2020-01-26T15:21:47.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ca40022a0 con 0x7f6cbc14b3f0 2020-01-26T15:21:47.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6cb40039b0 con 0x7f6cbc1480f0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.846 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1981725275 0 0) 0x7f6ca4002620 con 0x7f6cbc14b3f0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6c9c002ea0 con 0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1839147383 0 0) 0x7f6cb4003d30 con 0x7f6cbc1480f0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6c9c0046b0 con 0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2979115089 0 0) 0x7f6cb40041d0 con 0x7f6cbc1480f0 2020-01-26T15:21:47.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 >> 172.21.15.129:6790/0 conn(0x7f6cbc14b3f0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:21:47.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc07a890 con 0 2020-01-26T15:21:47.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6cbc0ea010 con 0x7f6cbc1480f0 2020-01-26T15:21:47.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cb9d6f700 1 -- 172.21.15.129:0/370045237 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6cb4001390 con 0x7f6cbc1480f0 2020-01-26T15:21:47.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- 172.21.15.129:0/370045237 >> 172.21.15.129:6789/0 conn(0x7f6cbc1480f0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:21:47.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- 172.21.15.129:0/370045237 shutdown_connections 2020-01-26T15:21:47.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- 172.21.15.129:0/370045237 shutdown_connections 2020-01-26T15:21:47.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- 172.21.15.129:0/370045237 wait complete. 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- 172.21.15.129:0/370045237 >> 172.21.15.129:0/370045237 conn(0x7f6cbc144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 Processor -- start 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- - start start 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0a3c30 con 0 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cc0da6700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0a6a00 con 0 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.850 7f6cbad71700 1 -- 172.21.15.129:0/4287430706 learned_addr learned my addr 172.21.15.129:0/4287430706 2020-01-26T15:21:47.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ca4002bb0 con 0x7f6cbc0a6250 2020-01-26T15:21:47.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1609182154 0 0) 0x7f6ca4002070 con 0x7f6cbc0a6250 2020-01-26T15:21:47.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ca0002960 con 0 2020-01-26T15:21:47.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6cb40011d0 con 0x7f6cbc0a3240 2020-01-26T15:21:47.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1763860758 0 0) 0x7f6cb40037c0 con 0x7f6cbc0a3240 2020-01-26T15:21:47.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6ca0004620 con 0 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1230085803 0 0) 0x7f6ca4002510 con 0x7f6cbc0a6250 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ca0002ee0 con 0 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3874421083 0 0) 0x7f6cb4003b40 con 0x7f6cbc0a3240 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ca0003540 con 0 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (499066712 0 0) 0x7f6ca40010f0 con 0x7f6cbc0a6250 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 >> 172.21.15.129:6790/0 conn(0x7f6cbc0a3240 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:21:47.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc07aaf0 con 0 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc0b25f0 con 0 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc18b190 con 0 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6cbc116ea0 con 0x7f6cbc0a6250 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6ca4001520 con 0x7f6cbc0a6250 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f6ca4002ed0 con 0x7f6cbc0a6250 2020-01-26T15:21:47.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.854 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f6ca4004b20 con 0x7f6cbc0a6250 2020-01-26T15:21:47.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.862 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc07ae70 con 0 2020-01-26T15:21:47.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.866 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6ca4004dc0 con 0x7f6cbc0a6250 2020-01-26T15:21:47.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.958 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6cbc073160 con 0 2020-01-26T15:21:47.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.958 7f6cb3fff700 1 -- 172.21.15.129:0/4287430706 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (574334944 0 3050755158) 0x7f6cbc07ae70 con 0x7f6cbc0a6250 2020-01-26T15:21:47.961 INFO:teuthology.orchestra.run.smithi129.stdout:38654705668 2020-01-26T15:21:47.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.958 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 >> 172.21.15.129:6800/11038 conn(0x7f6ca0006e70 :-1 s=STATE_OPEN pgs=50 cs=1 l=1).mark_down 2020-01-26T15:21:47.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.958 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 >> 172.21.15.129:6791/0 conn(0x7f6cbc0a6250 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:21:47.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.958 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 shutdown_connections 2020-01-26T15:21:47.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.962 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 shutdown_connections 2020-01-26T15:21:47.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.962 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 wait complete. 2020-01-26T15:21:47.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:47.962 7f6cc0da6700 1 -- 172.21.15.129:0/4287430706 >> 172.21.15.129:0/4287430706 conn(0x7f6cbc099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:47.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2020-01-26T15:21:48.973 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:21:49.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.070 7fe3cd310700 1 Processor -- start 2020-01-26T15:21:49.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.070 7fe3cd310700 1 -- - start start 2020-01-26T15:21:49.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.070 7fe3cd310700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c814bb30 con 0 2020-01-26T15:21:49.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.070 7fe3cd310700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c814bed0 con 0 2020-01-26T15:21:49.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.070 7fe3c7269700 1 -- 172.21.15.129:0/166698206 learned_addr learned my addr 172.21.15.129:0/166698206 2020-01-26T15:21:49.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3bc002220 con 0x7fe3c814b3f0 2020-01-26T15:21:49.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3b8003630 con 0x7fe3c81480f0 2020-01-26T15:21:49.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2789470462 0 0) 0x7fe3bc0025a0 con 0x7fe3c814b3f0 2020-01-26T15:21:49.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe3b4002ea0 con 0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (784029358 0 0) 0x7fe3b8003930 con 0x7fe3c81480f0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe3b40046b0 con 0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1257088975 0 0) 0x7fe3b8003dd0 con 0x7fe3c81480f0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 >> 172.21.15.129:6790/0 conn(0x7fe3c814b3f0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c807a890 con 0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe3c80ea010 con 0x7fe3c81480f0 2020-01-26T15:21:49.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3c6267700 1 -- 172.21.15.129:0/166698206 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3b8001010 con 0x7fe3c81480f0 2020-01-26T15:21:49.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3cd310700 1 -- 172.21.15.129:0/166698206 >> 172.21.15.129:6791/0 conn(0x7fe3c81480f0 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:21:49.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3cd310700 1 -- 172.21.15.129:0/166698206 shutdown_connections 2020-01-26T15:21:49.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3cd310700 1 -- 172.21.15.129:0/166698206 shutdown_connections 2020-01-26T15:21:49.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3cd310700 1 -- 172.21.15.129:0/166698206 wait complete. 2020-01-26T15:21:49.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.074 7fe3cd310700 1 -- 172.21.15.129:0/166698206 >> 172.21.15.129:0/166698206 conn(0x7fe3c8144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 Processor -- start 2020-01-26T15:21:49.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 -- - start start 2020-01-26T15:21:49.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c80a3b80 con 0 2020-01-26T15:21:49.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c80a67f0 con 0 2020-01-26T15:21:49.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c7269700 1 -- 172.21.15.129:0/210261846 learned_addr learned my addr 172.21.15.129:0/210261846 2020-01-26T15:21:49.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3b8000e50 con 0x7fe3c80a3190 2020-01-26T15:21:49.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3503550802 0 0) 0x7fe3b8003440 con 0x7fe3c80a3190 2020-01-26T15:21:49.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe3a8002960 con 0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3bc002ae0 con 0x7fe3c80a61a0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2078934249 0 0) 0x7fe3bc002060 con 0x7fe3c80a61a0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fe3a8004620 con 0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1930205374 0 0) 0x7fe3b8003840 con 0x7fe3c80a3190 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3a8002ee0 con 0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3658777215 0 0) 0x7fe3bc0023f0 con 0x7fe3c80a61a0 2020-01-26T15:21:49.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3a8003540 con 0 2020-01-26T15:21:49.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1667418919 0 0) 0x7fe3b80017d0 con 0x7fe3c80a3190 2020-01-26T15:21:49.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 >> 172.21.15.129:6789/0 conn(0x7fe3c80a61a0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:21:49.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c807aaf0 con 0 2020-01-26T15:21:49.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c80b25b0 con 0 2020-01-26T15:21:49.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.078 7fe3cd310700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c818b040 con 0 2020-01-26T15:21:49.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.082 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fe3b8001320 con 0x7fe3c80a3190 2020-01-26T15:21:49.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.082 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fe3b8001c00 con 0x7fe3c80a3190 2020-01-26T15:21:49.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.082 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fe3b8004780 con 0x7fe3c80a3190 2020-01-26T15:21:49.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.082 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fe3b8006240 con 0x7fe3c80a3190 2020-01-26T15:21:49.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.086 7fe3cd310700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a4002070 con 0 2020-01-26T15:21:49.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.086 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fe3b8004260 con 0x7fe3c80a3190 2020-01-26T15:21:49.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3a4001220 con 0 2020-01-26T15:21:49.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3c4a64700 1 -- 172.21.15.129:0/210261846 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (574334944 0 2374206864) 0x7fe3b8004520 con 0x7fe3c80a3190 2020-01-26T15:21:49.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 >> 172.21.15.129:6800/11038 conn(0x7fe3a8006e70 :-1 s=STATE_OPEN pgs=51 cs=1 l=1).mark_down 2020-01-26T15:21:49.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 >> 172.21.15.129:6790/0 conn(0x7fe3c80a3190 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:21:49.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 shutdown_connections 2020-01-26T15:21:49.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 shutdown_connections 2020-01-26T15:21:49.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 wait complete. 2020-01-26T15:21:49.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.182 7fe3cd310700 1 -- 172.21.15.129:0/210261846 >> 172.21.15.129:0/210261846 conn(0x7fe3c80992e0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.189 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:49.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2020-01-26T15:21:49.195 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:21:49.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.286 7f03083b6700 1 Processor -- start 2020-01-26T15:21:49.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- - start start 2020-01-26T15:21:49.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030014bb30 con 0 2020-01-26T15:21:49.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030014bed0 con 0 2020-01-26T15:21:49.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03063dc700 1 -- 172.21.15.129:0/3008318671 learned_addr learned my addr 172.21.15.129:0/3008318671 2020-01-26T15:21:49.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02fc003630 con 0x7f03001480f0 2020-01-26T15:21:49.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (162374179 0 0) 0x7f02fc0039b0 con 0x7f03001480f0 2020-01-26T15:21:49.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e8002a20 con 0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02f40022a0 con 0x7f030014b3f0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1957929276 0 0) 0x7f02f4002620 con 0x7f030014b3f0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e80046c0 con 0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2689449045 0 0) 0x7f02fc003f80 con 0x7f03001480f0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 >> 172.21.15.129:6790/0 conn(0x7f030014b3f0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030007a890 con 0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f03000ea010 con 0x7f03001480f0 2020-01-26T15:21:49.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03053da700 1 -- 172.21.15.129:0/3008318671 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02fc001050 con 0x7f03001480f0 2020-01-26T15:21:49.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- 172.21.15.129:0/3008318671 >> 172.21.15.129:6789/0 conn(0x7f03001480f0 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:21:49.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- 172.21.15.129:0/3008318671 shutdown_connections 2020-01-26T15:21:49.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- 172.21.15.129:0/3008318671 shutdown_connections 2020-01-26T15:21:49.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- 172.21.15.129:0/3008318671 wait complete. 2020-01-26T15:21:49.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.290 7f03083b6700 1 -- 172.21.15.129:0/3008318671 >> 172.21.15.129:0/3008318671 conn(0x7f0300144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f03083b6700 1 Processor -- start 2020-01-26T15:21:49.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f03083b6700 1 -- - start start 2020-01-26T15:21:49.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f03083b6700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000a3c30 con 0 2020-01-26T15:21:49.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f03083b6700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000a6a00 con 0 2020-01-26T15:21:49.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f03063dc700 1 -- 172.21.15.129:0/2432362876 learned_addr learned my addr 172.21.15.129:0/2432362876 2020-01-26T15:21:49.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02fc000e50 con 0x7f03000a3240 2020-01-26T15:21:49.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (683360594 0 0) 0x7f02fc001570 con 0x7f03000a3240 2020-01-26T15:21:49.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e0002960 con 0 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02f4002b60 con 0x7f03000a6250 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2633935208 0 0) 0x7f02f40020b0 con 0x7f03000a6250 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.294 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f02e0004620 con 0 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1618941624 0 0) 0x7f02fc0018f0 con 0x7f03000a3240 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02e0002ee0 con 0 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (858281089 0 0) 0x7f02f4002510 con 0x7f03000a6250 2020-01-26T15:21:49.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02e0003540 con 0 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2487451210 0 0) 0x7f02fc003620 con 0x7f03000a3240 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 >> 172.21.15.129:6790/0 conn(0x7f03000a6250 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030007aaf0 con 0 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f03083b6700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03000b25f0 con 0 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f03083b6700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f030018b190 con 0 2020-01-26T15:21:49.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f02fc001360 con 0x7f03000a3240 2020-01-26T15:21:49.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f02fc003a50 con 0x7f03000a3240 2020-01-26T15:21:49.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f02fc004990 con 0x7f03000a3240 2020-01-26T15:21:49.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.298 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f02fc004d10 con 0x7f03000a3240 2020-01-26T15:21:49.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.302 7f03083b6700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030007ae70 con 0 2020-01-26T15:21:49.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.306 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f030007ae70 con 0x7f03000a3240 2020-01-26T15:21:49.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0300073160 con 0 2020-01-26T15:21:49.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f02f37fe700 1 -- 172.21.15.129:0/2432362876 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (832126871 0 2374206864) 0x7f02fc004470 con 0x7f03000a3240 2020-01-26T15:21:49.404 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:49.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 >> 172.21.15.129:6800/11038 conn(0x7f02e0006ed0 :-1 s=STATE_OPEN pgs=52 cs=1 l=1).mark_down 2020-01-26T15:21:49.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 >> 172.21.15.129:6789/0 conn(0x7f03000a3240 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:21:49.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 shutdown_connections 2020-01-26T15:21:49.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 shutdown_connections 2020-01-26T15:21:49.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 wait complete. 2020-01-26T15:21:49.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.402 7f03083b6700 1 -- 172.21.15.129:0/2432362876 >> 172.21.15.129:0/2432362876 conn(0x7f0300099330 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2020-01-26T15:21:49.416 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:21:49.509 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.506 7f64b11fb700 1 Processor -- start 2020-01-26T15:21:49.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.506 7f64b11fb700 1 -- - start start 2020-01-26T15:21:49.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac14bb30 con 0 2020-01-26T15:21:49.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac14bed0 con 0 2020-01-26T15:21:49.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa826700 1 -- 172.21.15.129:0/970557913 learned_addr learned my addr 172.21.15.129:0/970557913 2020-01-26T15:21:49.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f649c002220 con 0x7f64ac1480f0 2020-01-26T15:21:49.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64a0003630 con 0x7f64ac14b3f0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1616838388 0 0) 0x7f649c0025a0 con 0x7f64ac1480f0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6498002ea0 con 0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3449952280 0 0) 0x7f64a00039b0 con 0x7f64ac14b3f0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f64980046b0 con 0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1102471911 0 0) 0x7f649c002a40 con 0x7f64ac1480f0 2020-01-26T15:21:49.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 >> 172.21.15.129:6791/0 conn(0x7f64ac14b3f0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac07a890 con 0 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f64ac0ea010 con 0x7f64ac1480f0 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64aa025700 1 -- 172.21.15.129:0/970557913 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f649c001010 con 0x7f64ac1480f0 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- 172.21.15.129:0/970557913 >> 172.21.15.129:6790/0 conn(0x7f64ac1480f0 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- 172.21.15.129:0/970557913 shutdown_connections 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- 172.21.15.129:0/970557913 shutdown_connections 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- 172.21.15.129:0/970557913 wait complete. 2020-01-26T15:21:49.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.510 7f64b11fb700 1 -- 172.21.15.129:0/970557913 >> 172.21.15.129:0/970557913 conn(0x7f64ac144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64b11fb700 1 Processor -- start 2020-01-26T15:21:49.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64b11fb700 1 -- - start start 2020-01-26T15:21:49.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64b11fb700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0a3e50 con 0 2020-01-26T15:21:49.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64b11fb700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0a5370 con 0 2020-01-26T15:21:49.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64aa826700 1 -- 172.21.15.129:0/2206909021 learned_addr learned my addr 172.21.15.129:0/2206909021 2020-01-26T15:21:49.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f649c002c00 con 0x7f64ac095ca0 2020-01-26T15:21:49.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1124795696 0 0) 0x7f649c000f10 con 0x7f64ac095ca0 2020-01-26T15:21:49.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f648c002960 con 0 2020-01-26T15:21:49.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64a0003470 con 0x7f64ac0a3460 2020-01-26T15:21:49.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (126883748 0 0) 0x7f64a0003d30 con 0x7f64ac0a3460 2020-01-26T15:21:49.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f648c004620 con 0 2020-01-26T15:21:49.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1266527875 0 0) 0x7f649c0021d0 con 0x7f64ac095ca0 2020-01-26T15:21:49.544 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f648c002ee0 con 0 2020-01-26T15:21:49.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1704528062 0 0) 0x7f64a0003fa0 con 0x7f64ac0a3460 2020-01-26T15:21:49.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f648c003540 con 0 2020-01-26T15:21:49.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (762315270 0 0) 0x7f649c0017d0 con 0x7f64ac095ca0 2020-01-26T15:21:49.545 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 >> 172.21.15.129:6790/0 conn(0x7f64ac0a3460 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:21:49.546 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64a8822700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac07aaf0 con 0 2020-01-26T15:21:49.546 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.514 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0b28a0 con 0 2020-01-26T15:21:49.546 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.518 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0a6ca0 con 0 2020-01-26T15:21:49.546 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.518 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f649c001320 con 0x7f64ac095ca0 2020-01-26T15:21:49.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.518 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f649c001a40 con 0x7f64ac095ca0 2020-01-26T15:21:49.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.518 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f649c0033f0 con 0x7f64ac095ca0 2020-01-26T15:21:49.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.518 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f649c0037c0 con 0x7f64ac095ca0 2020-01-26T15:21:49.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.522 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac07ae70 con 0 2020-01-26T15:21:49.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.526 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f64ac07ae70 con 0x7f64ac095ca0 2020-01-26T15:21:49.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f64ac1563f0 con 0 2020-01-26T15:21:49.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64a8822700 1 -- 172.21.15.129:0/2206909021 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (92182286 0 2374206864) 0x7f649c002e80 con 0x7f64ac095ca0 2020-01-26T15:21:49.620 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:49.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 >> 172.21.15.129:6800/11038 conn(0x7f648c006ed0 :-1 s=STATE_OPEN pgs=53 cs=1 l=1).mark_down 2020-01-26T15:21:49.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 >> 172.21.15.129:6789/0 conn(0x7f64ac095ca0 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:21:49.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 shutdown_connections 2020-01-26T15:21:49.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 shutdown_connections 2020-01-26T15:21:49.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 wait complete. 2020-01-26T15:21:49.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.618 7f64b11fb700 1 -- 172.21.15.129:0/2206909021 >> 172.21.15.129:0/2206909021 conn(0x7f64ac099640 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2020-01-26T15:21:49.637 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:21:49.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.722 7f307a0ab700 1 Processor -- start 2020-01-26T15:21:49.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.722 7f307a0ab700 1 -- - start start 2020-01-26T15:21:49.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307414bb30 con 0 2020-01-26T15:21:49.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307414bed0 con 0 2020-01-26T15:21:49.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f30737fe700 1 -- 172.21.15.129:0/4202683798 learned_addr learned my addr 172.21.15.129:0/4202683798 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3068003630 con 0x7f307414b3f0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (462745599 0 0) 0x7f30680039b0 con 0x7f307414b3f0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3060002a20 con 0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f30640022a0 con 0x7f30741480f0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1526757295 0 0) 0x7f3064002620 con 0x7f30741480f0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f30600046c0 con 0 2020-01-26T15:21:49.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1396433985 0 0) 0x7f3068003f80 con 0x7f307414b3f0 2020-01-26T15:21:49.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 >> 172.21.15.129:6790/0 conn(0x7f30741480f0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:21:49.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307407a890 con 0 2020-01-26T15:21:49.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3074116ea0 con 0x7f307414b3f0 2020-01-26T15:21:49.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f3072ffd700 1 -- 172.21.15.129:0/4202683798 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3068001050 con 0x7f307414b3f0 2020-01-26T15:21:49.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- 172.21.15.129:0/4202683798 >> 172.21.15.129:6791/0 conn(0x7f307414b3f0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:21:49.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- 172.21.15.129:0/4202683798 shutdown_connections 2020-01-26T15:21:49.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- 172.21.15.129:0/4202683798 shutdown_connections 2020-01-26T15:21:49.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- 172.21.15.129:0/4202683798 wait complete. 2020-01-26T15:21:49.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.726 7f307a0ab700 1 -- 172.21.15.129:0/4202683798 >> 172.21.15.129:0/4202683798 conn(0x7f3074144020 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f307a0ab700 1 Processor -- start 2020-01-26T15:21:49.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f307a0ab700 1 -- - start start 2020-01-26T15:21:49.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f307a0ab700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740a3c40 con 0 2020-01-26T15:21:49.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f307a0ab700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740a6820 con 0 2020-01-26T15:21:49.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f3073fff700 1 -- 172.21.15.129:0/2157834463 learned_addr learned my addr 172.21.15.129:0/2157834463 2020-01-26T15:21:49.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3068000e50 con 0x7f30740a61d0 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2643925465 0 0) 0x7f3068001570 con 0x7f30740a61d0 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3054002960 con 0 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3064002270 con 0x7f30740a3250 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2255941874 0 0) 0x7f30640029b0 con 0x7f30740a3250 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3054004620 con 0 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3564443709 0 0) 0x7f30680019c0 con 0x7f30740a61d0 2020-01-26T15:21:49.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3054002ee0 con 0 2020-01-26T15:21:49.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3880464459 0 0) 0x7f3064000e50 con 0x7f30740a3250 2020-01-26T15:21:49.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3054003540 con 0 2020-01-26T15:21:49.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2014855362 0 0) 0x7f3068003620 con 0x7f30740a61d0 2020-01-26T15:21:49.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 >> 172.21.15.129:6790/0 conn(0x7f30740a3250 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:21:49.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f30717fa700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307407aaf0 con 0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.730 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30740b26f0 con 0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.734 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3068001360 con 0x7f30740a61d0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.734 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f307418b120 con 0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.734 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3068003a50 con 0x7f30740a61d0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.734 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f3068004870 con 0x7f30740a61d0 2020-01-26T15:21:49.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.734 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f3068004350 con 0x7f30740a61d0 2020-01-26T15:21:49.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.738 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307407ae70 con 0 2020-01-26T15:21:49.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.742 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f307407ae70 con 0x7f30740a61d0 2020-01-26T15:21:49.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.834 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3074073160 con 0 2020-01-26T15:21:49.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f30717fa700 1 -- 172.21.15.129:0/2157834463 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (383520633 0 2374206864) 0x7f3068004c90 con 0x7f30740a61d0 2020-01-26T15:21:49.841 INFO:teuthology.orchestra.run.smithi129.stdout:38654705670 2020-01-26T15:21:49.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 >> 172.21.15.129:6800/11038 conn(0x7f3054006e70 :-1 s=STATE_OPEN pgs=54 cs=1 l=1).mark_down 2020-01-26T15:21:49.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 >> 172.21.15.129:6789/0 conn(0x7f30740a61d0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:21:49.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 shutdown_connections 2020-01-26T15:21:49.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 shutdown_connections 2020-01-26T15:21:49.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 wait complete. 2020-01-26T15:21:49.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.838 7f307a0ab700 1 -- 172.21.15.129:0/2157834463 >> 172.21.15.129:0/2157834463 conn(0x7f3074099340 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2020-01-26T15:21:49.851 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:21:49.852 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:21:49.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f305882c700 1 Processor -- start 2020-01-26T15:21:49.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f305882c700 1 -- - start start 2020-01-26T15:21:49.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f305882c700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305414bb60 con 0 2020-01-26T15:21:49.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f305882c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305414bf00 con 0 2020-01-26T15:21:49.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3052826700 1 -- 172.21.15.129:0/1531832698 learned_addr learned my addr 172.21.15.129:0/1531832698 2020-01-26T15:21:49.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f303c0022a0 con 0x7f305414b3d0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (546670203 0 0) 0x7f303c002620 con 0x7f305414b3d0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3051824700 1 -- 172.21.15.129:0/1531832698 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3034002a20 con 0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f30440039b0 con 0x7f30541480d0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.934 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2470050791 0 0) 0x7f3044003cb0 con 0x7f30541480d0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f30340046b0 con 0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3394839219 0 0) 0x7f3044004150 con 0x7f30541480d0 2020-01-26T15:21:49.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 >> 172.21.15.129:6791/0 conn(0x7f305414b3d0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305407a930 con 0 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f30540e9ff0 con 0x7f30541480d0 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- 172.21.15.129:0/1531832698 >> 172.21.15.129:6790/0 conn(0x7f30541480d0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3051824700 1 -- 172.21.15.129:0/1531832698 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f30440011d0 con 0x7f30541480d0 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- 172.21.15.129:0/1531832698 shutdown_connections 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- 172.21.15.129:0/1531832698 shutdown_connections 2020-01-26T15:21:49.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- 172.21.15.129:0/1531832698 wait complete. 2020-01-26T15:21:49.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- 172.21.15.129:0/1531832698 >> 172.21.15.129:0/1531832698 conn(0x7f3054144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:49.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 Processor -- start 2020-01-26T15:21:49.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- - start start 2020-01-26T15:21:49.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540a3e80 con 0 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f305882c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540a3600 con 0 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f3052025700 1 -- 172.21.15.129:0/3790574529 learned_addr learned my addr 172.21.15.129:0/3790574529 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f303c0022a0 con 0x7f30540a5250 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2798363541 0 0) 0x7f303c002520 con 0x7f30540a5250 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f304bfff700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3038002960 con 0 2020-01-26T15:21:49.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.938 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3044004150 con 0x7f3054095d60 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2287256507 0 0) 0x7f3044003790 con 0x7f3054095d60 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3038004620 con 0 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2803823704 0 0) 0x7f303c000e50 con 0x7f30540a5250 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3038002ee0 con 0 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3202894298 0 0) 0x7f3044003c30 con 0x7f3054095d60 2020-01-26T15:21:49.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3038003540 con 0 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2414844052 0 0) 0x7f3044001990 con 0x7f3054095d60 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 >> 172.21.15.129:6791/0 conn(0x7f30540a5250 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305407ab90 con 0 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f305882c700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30540712f0 con 0 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f30440014e0 con 0x7f3054095d60 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3044001dc0 con 0x7f3054095d60 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f305882c700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f30540a6c40 con 0 2020-01-26T15:21:49.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f30440048b0 con 0x7f3054095d60 2020-01-26T15:21:49.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.942 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f30440052a0 con 0x7f3054095d60 2020-01-26T15:21:49.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.950 7f305882c700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305407af30 con 0 2020-01-26T15:21:49.956 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:49.954 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f305407af30 con 0x7f3054095d60 2020-01-26T15:21:50.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.046 7f305882c700 1 -- 172.21.15.129:0/3790574529 --> 172.21.15.129:6800/11038 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f3054148860 con 0 2020-01-26T15:21:50.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.050 7f304bfff700 1 -- 172.21.15.129:0/3790574529 <== mgr.4100 172.21.15.129:6800/11038 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+59975 (2965378022 0 3918572861) 0x7f3054116e80 con 0x7f3038006e70 2020-01-26T15:21:50.056 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:21:50.057 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:50.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 >> 172.21.15.129:6800/11038 conn(0x7f3038006e70 :-1 s=STATE_OPEN pgs=55 cs=1 l=1).mark_down 2020-01-26T15:21:50.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 >> 172.21.15.129:6790/0 conn(0x7f3054095d60 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:21:50.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 shutdown_connections 2020-01-26T15:21:50.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 shutdown_connections 2020-01-26T15:21:50.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 wait complete. 2020-01-26T15:21:50.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.058 7f305882c700 1 -- 172.21.15.129:0/3790574529 >> 172.21.15.129:0/3790574529 conn(0x7f3054099680 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.071 INFO:teuthology.orchestra.run.smithi129.stdout:{"version":23,"stamp":"2020-01-26 15:21:49.884376","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"kb":377487360,"kb_used":4196608,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290752,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"2.018749"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202764","last_change":"2020-01-26 15:21:44.200448","last_active":"2020-01-26 15:21:44.202764","last_peered":"2020-01-26 15:21:44.202764","last_clean":"2020-01-26 15:21:44.202764","last_became_active":"2020-01-26 15:21:44.200120","last_became_peered":"2020-01-26 15:21:44.200120","last_unstale":"2020-01-26 15:21:44.202764","last_undegraded":"2020-01-26 15:21:44.202764","last_fullsized":"2020-01-26 15:21:44.202764","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195244","last_change":"2020-01-26 15:21:41.930393","last_active":"2020-01-26 15:21:44.195244","last_peered":"2020-01-26 15:21:44.195244","last_clean":"2020-01-26 15:21:44.195244","last_became_active":"2020-01-26 15:21:41.930041","last_became_peered":"2020-01-26 15:21:41.930041","last_unstale":"2020-01-26 15:21:44.195244","last_undegraded":"2020-01-26 15:21:44.195244","last_fullsized":"2020-01-26 15:21:44.195244","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.824586","last_change":"2020-01-26 15:21:43.942360","last_active":"2020-01-26 15:21:45.824586","last_peered":"2020-01-26 15:21:45.824586","last_clean":"2020-01-26 15:21:45.824586","last_became_active":"2020-01-26 15:21:43.941956","last_became_peered":"2020-01-26 15:21:43.941956","last_unstale":"2020-01-26 15:21:45.824586","last_undegraded":"2020-01-26 15:21:45.824586","last_fullsized":"2020-01-26 15:21:45.824586","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202294","last_change":"2020-01-26 15:21:44.200933","last_active":"2020-01-26 15:21:44.202294","last_peered":"2020-01-26 15:21:44.202294","last_clean":"2020-01-26 15:21:44.202294","last_became_active":"2020-01-26 15:21:44.200601","last_became_peered":"2020-01-26 15:21:44.200601","last_unstale":"2020-01-26 15:21:44.202294","last_undegraded":"2020-01-26 15:21:44.202294","last_fullsized":"2020-01-26 15:21:44.202294","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.196065","last_change":"2020-01-26 15:21:41.924886","last_active":"2020-01-26 15:21:44.196065","last_peered":"2020-01-26 15:21:44.196065","last_clean":"2020-01-26 15:21:44.196065","last_became_active":"2020-01-26 15:21:41.924413","last_became_peered":"2020-01-26 15:21:41.924413","last_unstale":"2020-01-26 15:21:44.196065","last_undegraded":"2020-01-26 15:21:44.196065","last_fullsized":"2020-01-26 15:21:44.196065","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"17","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.831955","last_change":"2020-01-26 15:21:43.943474","last_active":"2020-01-26 15:21:45.831955","last_peered":"2020-01-26 15:21:45.831955","last_clean":"2020-01-26 15:21:45.831955","last_became_active":"2020-01-26 15:21:43.943083","last_became_peered":"2020-01-26 15:21:43.943083","last_unstale":"2020-01-26 15:21:45.831955","last_undegraded":"2020-01-26 15:21:45.831955","last_fullsized":"2020-01-26 15:21:45.831955","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198103","last_change":"2020-01-26 15:21:44.197335","last_active":"2020-01-26 15:21:44.198103","last_peered":"2020-01-26 15:21:44.198103","last_clean":"2020-01-26 15:21:44.198103","last_became_active":"2020-01-26 15:21:44.196982","last_became_peered":"2020-01-26 15:21:44.196982","last_unstale":"2020-01-26 15:21:44.198103","last_undegraded":"2020-01-26 15:21:44.198103","last_fullsized":"2020-01-26 15:21:44.198103","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198390","last_change":"2020-01-26 15:21:41.928416","last_active":"2020-01-26 15:21:44.198390","last_peered":"2020-01-26 15:21:44.198390","last_clean":"2020-01-26 15:21:44.198390","last_became_active":"2020-01-26 15:21:41.928076","last_became_peered":"2020-01-26 15:21:41.928076","last_unstale":"2020-01-26 15:21:44.198390","last_undegraded":"2020-01-26 15:21:44.198390","last_fullsized":"2020-01-26 15:21:44.198390","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"18","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.827570","last_change":"2020-01-26 15:21:43.941003","last_active":"2020-01-26 15:21:45.827570","last_peered":"2020-01-26 15:21:45.827570","last_clean":"2020-01-26 15:21:45.827570","last_became_active":"2020-01-26 15:21:43.940619","last_became_peered":"2020-01-26 15:21:43.940619","last_unstale":"2020-01-26 15:21:45.827570","last_undegraded":"2020-01-26 15:21:45.827570","last_fullsized":"2020-01-26 15:21:45.827570","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.201250","last_change":"2020-01-26 15:21:44.200325","last_active":"2020-01-26 15:21:44.201250","last_peered":"2020-01-26 15:21:44.201250","last_clean":"2020-01-26 15:21:44.201250","last_became_active":"2020-01-26 15:21:44.199937","last_became_peered":"2020-01-26 15:21:44.199937","last_unstale":"2020-01-26 15:21:44.201250","last_undegraded":"2020-01-26 15:21:44.201250","last_fullsized":"2020-01-26 15:21:44.201250","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.194760","last_change":"2020-01-26 15:21:41.927799","last_active":"2020-01-26 15:21:44.194760","last_peered":"2020-01-26 15:21:44.194760","last_clean":"2020-01-26 15:21:44.194760","last_became_active":"2020-01-26 15:21:41.927403","last_became_peered":"2020-01-26 15:21:41.927403","last_unstale":"2020-01-26 15:21:44.194760","last_undegraded":"2020-01-26 15:21:44.194760","last_fullsized":"2020-01-26 15:21:44.194760","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.194655","last_change":"2020-01-26 15:21:43.939282","last_active":"2020-01-26 15:21:44.194655","last_peered":"2020-01-26 15:21:44.194655","last_clean":"2020-01-26 15:21:44.194655","last_became_active":"2020-01-26 15:21:43.938954","last_became_peered":"2020-01-26 15:21:43.938954","last_unstale":"2020-01-26 15:21:44.194655","last_undegraded":"2020-01-26 15:21:44.194655","last_fullsized":"2020-01-26 15:21:44.194655","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202785","last_change":"2020-01-26 15:21:44.201926","last_active":"2020-01-26 15:21:44.202785","last_peered":"2020-01-26 15:21:44.202785","last_clean":"2020-01-26 15:21:44.202785","last_became_active":"2020-01-26 15:21:44.201594","last_became_peered":"2020-01-26 15:21:44.201594","last_unstale":"2020-01-26 15:21:44.202785","last_undegraded":"2020-01-26 15:21:44.202785","last_fullsized":"2020-01-26 15:21:44.202785","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198085","last_change":"2020-01-26 15:21:41.925677","last_active":"2020-01-26 15:21:44.198085","last_peered":"2020-01-26 15:21:44.198085","last_clean":"2020-01-26 15:21:44.198085","last_became_active":"2020-01-26 15:21:41.925120","last_became_peered":"2020-01-26 15:21:41.925120","last_unstale":"2020-01-26 15:21:44.198085","last_undegraded":"2020-01-26 15:21:44.198085","last_fullsized":"2020-01-26 15:21:44.198085","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"15","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.827290","last_change":"2020-01-26 15:21:43.943006","last_active":"2020-01-26 15:21:45.827290","last_peered":"2020-01-26 15:21:45.827290","last_clean":"2020-01-26 15:21:45.827290","last_became_active":"2020-01-26 15:21:43.941028","last_became_peered":"2020-01-26 15:21:43.941028","last_unstale":"2020-01-26 15:21:45.827290","last_undegraded":"2020-01-26 15:21:45.827290","last_fullsized":"2020-01-26 15:21:45.827290","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198351","last_change":"2020-01-26 15:21:44.197371","last_active":"2020-01-26 15:21:44.198351","last_peered":"2020-01-26 15:21:44.198351","last_clean":"2020-01-26 15:21:44.198351","last_became_active":"2020-01-26 15:21:44.197041","last_became_peered":"2020-01-26 15:21:44.197041","last_unstale":"2020-01-26 15:21:44.198351","last_undegraded":"2020-01-26 15:21:44.198351","last_fullsized":"2020-01-26 15:21:44.198351","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195428","last_change":"2020-01-26 15:21:41.924864","last_active":"2020-01-26 15:21:44.195428","last_peered":"2020-01-26 15:21:44.195428","last_clean":"2020-01-26 15:21:44.195428","last_became_active":"2020-01-26 15:21:41.924454","last_became_peered":"2020-01-26 15:21:41.924454","last_unstale":"2020-01-26 15:21:44.195428","last_undegraded":"2020-01-26 15:21:44.195428","last_fullsized":"2020-01-26 15:21:44.195428","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.815558","last_change":"2020-01-26 15:21:43.939847","last_active":"2020-01-26 15:21:45.815558","last_peered":"2020-01-26 15:21:45.815558","last_clean":"2020-01-26 15:21:45.815558","last_became_active":"2020-01-26 15:21:43.939484","last_became_peered":"2020-01-26 15:21:43.939484","last_unstale":"2020-01-26 15:21:45.815558","last_undegraded":"2020-01-26 15:21:45.815558","last_fullsized":"2020-01-26 15:21:45.815558","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202637","last_change":"2020-01-26 15:21:44.202021","last_active":"2020-01-26 15:21:44.202637","last_peered":"2020-01-26 15:21:44.202637","last_clean":"2020-01-26 15:21:44.202637","last_became_active":"2020-01-26 15:21:44.201689","last_became_peered":"2020-01-26 15:21:44.201689","last_unstale":"2020-01-26 15:21:44.202637","last_undegraded":"2020-01-26 15:21:44.202637","last_fullsized":"2020-01-26 15:21:44.202637","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195545","last_change":"2020-01-26 15:21:41.928224","last_active":"2020-01-26 15:21:44.195545","last_peered":"2020-01-26 15:21:44.195545","last_clean":"2020-01-26 15:21:44.195545","last_became_active":"2020-01-26 15:21:41.927618","last_became_peered":"2020-01-26 15:21:41.927618","last_unstale":"2020-01-26 15:21:44.195545","last_undegraded":"2020-01-26 15:21:44.195545","last_fullsized":"2020-01-26 15:21:44.195545","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"16","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.826579","last_change":"2020-01-26 15:21:43.943353","last_active":"2020-01-26 15:21:45.826579","last_peered":"2020-01-26 15:21:45.826579","last_clean":"2020-01-26 15:21:45.826579","last_became_active":"2020-01-26 15:21:43.942956","last_became_peered":"2020-01-26 15:21:43.942956","last_unstale":"2020-01-26 15:21:45.826579","last_undegraded":"2020-01-26 15:21:45.826579","last_fullsized":"2020-01-26 15:21:45.826579","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.204505","last_change":"2020-01-26 15:21:44.203122","last_active":"2020-01-26 15:21:44.204505","last_peered":"2020-01-26 15:21:44.204505","last_clean":"2020-01-26 15:21:44.204505","last_became_active":"2020-01-26 15:21:44.202380","last_became_peered":"2020-01-26 15:21:44.202380","last_unstale":"2020-01-26 15:21:44.204505","last_undegraded":"2020-01-26 15:21:44.204505","last_fullsized":"2020-01-26 15:21:44.204505","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.199084","last_change":"2020-01-26 15:21:41.928890","last_active":"2020-01-26 15:21:44.199084","last_peered":"2020-01-26 15:21:44.199084","last_clean":"2020-01-26 15:21:44.199084","last_became_active":"2020-01-26 15:21:41.927480","last_became_peered":"2020-01-26 15:21:41.927480","last_unstale":"2020-01-26 15:21:44.199084","last_undegraded":"2020-01-26 15:21:44.199084","last_fullsized":"2020-01-26 15:21:44.199084","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"15'8","reported_seq":"18","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.826519","last_change":"2020-01-26 15:21:43.942785","last_active":"2020-01-26 15:21:45.826519","last_peered":"2020-01-26 15:21:45.826519","last_clean":"2020-01-26 15:21:45.826519","last_became_active":"2020-01-26 15:21:43.942416","last_became_peered":"2020-01-26 15:21:43.942416","last_unstale":"2020-01-26 15:21:45.826519","last_undegraded":"2020-01-26 15:21:45.826519","last_fullsized":"2020-01-26 15:21:45.826519","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":14,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.537}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.310}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.583}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":2,"kb":94371840,"kb_used":1049104,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322736,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.578}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.657}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.549}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":5,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.450}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.542}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.375}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049136,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322704,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.293}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.352}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.376}]}]}]} 2020-01-26T15:21:50.074 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:21:50.167 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7faa0126d700 1 Processor -- start 2020-01-26T15:21:50.168 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7faa0126d700 1 -- - start start 2020-01-26T15:21:50.168 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7faa0126d700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc14bb10 con 0 2020-01-26T15:21:50.168 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7faa0126d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc14beb0 con 0 2020-01-26T15:21:50.168 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fb269700 1 -- 172.21.15.129:0/3853356550 learned_addr learned my addr 172.21.15.129:0/3853356550 2020-01-26T15:21:50.169 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9f40039b0 con 0x7fa9fc1480d0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1599535390 0 0) 0x7fa9f4003d30 con 0x7fa9fc1480d0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa9dc002a20 con 0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9e40022a0 con 0x7fa9fc14b3d0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1012605795 0 0) 0x7fa9e4002620 con 0x7fa9fc14b3d0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa9dc0046c0 con 0 2020-01-26T15:21:50.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3623612569 0 0) 0x7fa9f4004300 con 0x7fa9fc1480d0 2020-01-26T15:21:50.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 >> 172.21.15.129:6789/0 conn(0x7fa9fc14b3d0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:21:50.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc07a930 con 0 2020-01-26T15:21:50.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa9fc0e9ff0 con 0x7fa9fc1480d0 2020-01-26T15:21:50.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7fa9fa267700 1 -- 172.21.15.129:0/3853356550 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9f40013d0 con 0x7fa9fc1480d0 2020-01-26T15:21:50.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.166 7faa0126d700 1 -- 172.21.15.129:0/3853356550 >> 172.21.15.129:6791/0 conn(0x7fa9fc1480d0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:21:50.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- 172.21.15.129:0/3853356550 shutdown_connections 2020-01-26T15:21:50.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- 172.21.15.129:0/3853356550 shutdown_connections 2020-01-26T15:21:50.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- 172.21.15.129:0/3853356550 wait complete. 2020-01-26T15:21:50.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- 172.21.15.129:0/3853356550 >> 172.21.15.129:0/3853356550 conn(0x7fa9fc144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 Processor -- start 2020-01-26T15:21:50.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- - start start 2020-01-26T15:21:50.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0a3cf0 con 0 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7faa0126d700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0a6ac0 con 0 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7fa9fb269700 1 -- 172.21.15.129:0/490218328 learned_addr learned my addr 172.21.15.129:0/490218328 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9e40020e0 con 0x7fa9fc0a6310 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2325586964 0 0) 0x7fa9e40029b0 con 0x7fa9fc0a6310 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa9e0002960 con 0 2020-01-26T15:21:50.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.170 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9f40011d0 con 0x7fa9fc0a3300 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2377882837 0 0) 0x7fa9f40018f0 con 0x7fa9fc0a3300 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa9e0004620 con 0 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1759354298 0 0) 0x7fa9e4000e50 con 0x7fa9fc0a6310 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9e0002ee0 con 0 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1333429180 0 0) 0x7fa9f4001c70 con 0x7fa9fc0a3300 2020-01-26T15:21:50.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9e0003540 con 0 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3449514598 0 0) 0x7fa9e4001360 con 0x7fa9fc0a6310 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 >> 172.21.15.129:6790/0 conn(0x7fa9fc0a3300 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc07ab90 con 0 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7faa0126d700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc0b2910 con 0 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7faa0126d700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc18b170 con 0 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa9fc116e80 con 0x7fa9fc0a6310 2020-01-26T15:21:50.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa9e4001790 con 0x7fa9fc0a6310 2020-01-26T15:21:50.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa9e40019d0 con 0x7fa9fc0a6310 2020-01-26T15:21:50.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.174 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7fa9e40049f0 con 0x7fa9fc0a6310 2020-01-26T15:21:50.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.178 7faa0126d700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc07af30 con 0 2020-01-26T15:21:50.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.186 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa9fc07af30 con 0x7fa9fc0a6310 2020-01-26T15:21:50.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.278 7faa0126d700 1 -- 172.21.15.129:0/490218328 --> 172.21.15.129:6800/11038 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7fa9fc148860 con 0 2020-01-26T15:21:50.282 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.278 7fa9f8a64700 1 -- 172.21.15.129:0/490218328 <== mgr.4100 172.21.15.129:6800/11038 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+59975 (2965378022 0 3918572861) 0x7fa9f4000f70 con 0x7fa9e0006ed0 2020-01-26T15:21:50.287 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:21:50.287 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 >> 172.21.15.129:6800/11038 conn(0x7fa9e0006ed0 :-1 s=STATE_OPEN pgs=56 cs=1 l=1).mark_down 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 >> 172.21.15.129:6791/0 conn(0x7fa9fc0a6310 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 shutdown_connections 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 shutdown_connections 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 wait complete. 2020-01-26T15:21:50.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.286 7faa0126d700 1 -- 172.21.15.129:0/490218328 >> 172.21.15.129:0/490218328 conn(0x7fa9fc099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.303 INFO:teuthology.orchestra.run.smithi129.stdout:{"version":23,"stamp":"2020-01-26 15:21:49.884376","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"kb":377487360,"kb_used":4196608,"kb_used_data":2240,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290752,"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"stamp_delta":"2.018749"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202764","last_change":"2020-01-26 15:21:44.200448","last_active":"2020-01-26 15:21:44.202764","last_peered":"2020-01-26 15:21:44.202764","last_clean":"2020-01-26 15:21:44.202764","last_became_active":"2020-01-26 15:21:44.200120","last_became_peered":"2020-01-26 15:21:44.200120","last_unstale":"2020-01-26 15:21:44.202764","last_undegraded":"2020-01-26 15:21:44.202764","last_fullsized":"2020-01-26 15:21:44.202764","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195244","last_change":"2020-01-26 15:21:41.930393","last_active":"2020-01-26 15:21:44.195244","last_peered":"2020-01-26 15:21:44.195244","last_clean":"2020-01-26 15:21:44.195244","last_became_active":"2020-01-26 15:21:41.930041","last_became_peered":"2020-01-26 15:21:41.930041","last_unstale":"2020-01-26 15:21:44.195244","last_undegraded":"2020-01-26 15:21:44.195244","last_fullsized":"2020-01-26 15:21:44.195244","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.824586","last_change":"2020-01-26 15:21:43.942360","last_active":"2020-01-26 15:21:45.824586","last_peered":"2020-01-26 15:21:45.824586","last_clean":"2020-01-26 15:21:45.824586","last_became_active":"2020-01-26 15:21:43.941956","last_became_peered":"2020-01-26 15:21:43.941956","last_unstale":"2020-01-26 15:21:45.824586","last_undegraded":"2020-01-26 15:21:45.824586","last_fullsized":"2020-01-26 15:21:45.824586","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202294","last_change":"2020-01-26 15:21:44.200933","last_active":"2020-01-26 15:21:44.202294","last_peered":"2020-01-26 15:21:44.202294","last_clean":"2020-01-26 15:21:44.202294","last_became_active":"2020-01-26 15:21:44.200601","last_became_peered":"2020-01-26 15:21:44.200601","last_unstale":"2020-01-26 15:21:44.202294","last_undegraded":"2020-01-26 15:21:44.202294","last_fullsized":"2020-01-26 15:21:44.202294","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.196065","last_change":"2020-01-26 15:21:41.924886","last_active":"2020-01-26 15:21:44.196065","last_peered":"2020-01-26 15:21:44.196065","last_clean":"2020-01-26 15:21:44.196065","last_became_active":"2020-01-26 15:21:41.924413","last_became_peered":"2020-01-26 15:21:41.924413","last_unstale":"2020-01-26 15:21:44.196065","last_undegraded":"2020-01-26 15:21:44.196065","last_fullsized":"2020-01-26 15:21:44.196065","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"17","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.831955","last_change":"2020-01-26 15:21:43.943474","last_active":"2020-01-26 15:21:45.831955","last_peered":"2020-01-26 15:21:45.831955","last_clean":"2020-01-26 15:21:45.831955","last_became_active":"2020-01-26 15:21:43.943083","last_became_peered":"2020-01-26 15:21:43.943083","last_unstale":"2020-01-26 15:21:45.831955","last_undegraded":"2020-01-26 15:21:45.831955","last_fullsized":"2020-01-26 15:21:45.831955","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198103","last_change":"2020-01-26 15:21:44.197335","last_active":"2020-01-26 15:21:44.198103","last_peered":"2020-01-26 15:21:44.198103","last_clean":"2020-01-26 15:21:44.198103","last_became_active":"2020-01-26 15:21:44.196982","last_became_peered":"2020-01-26 15:21:44.196982","last_unstale":"2020-01-26 15:21:44.198103","last_undegraded":"2020-01-26 15:21:44.198103","last_fullsized":"2020-01-26 15:21:44.198103","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198390","last_change":"2020-01-26 15:21:41.928416","last_active":"2020-01-26 15:21:44.198390","last_peered":"2020-01-26 15:21:44.198390","last_clean":"2020-01-26 15:21:44.198390","last_became_active":"2020-01-26 15:21:41.928076","last_became_peered":"2020-01-26 15:21:41.928076","last_unstale":"2020-01-26 15:21:44.198390","last_undegraded":"2020-01-26 15:21:44.198390","last_fullsized":"2020-01-26 15:21:44.198390","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"18","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.827570","last_change":"2020-01-26 15:21:43.941003","last_active":"2020-01-26 15:21:45.827570","last_peered":"2020-01-26 15:21:45.827570","last_clean":"2020-01-26 15:21:45.827570","last_became_active":"2020-01-26 15:21:43.940619","last_became_peered":"2020-01-26 15:21:43.940619","last_unstale":"2020-01-26 15:21:45.827570","last_undegraded":"2020-01-26 15:21:45.827570","last_fullsized":"2020-01-26 15:21:45.827570","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.201250","last_change":"2020-01-26 15:21:44.200325","last_active":"2020-01-26 15:21:44.201250","last_peered":"2020-01-26 15:21:44.201250","last_clean":"2020-01-26 15:21:44.201250","last_became_active":"2020-01-26 15:21:44.199937","last_became_peered":"2020-01-26 15:21:44.199937","last_unstale":"2020-01-26 15:21:44.201250","last_undegraded":"2020-01-26 15:21:44.201250","last_fullsized":"2020-01-26 15:21:44.201250","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.194760","last_change":"2020-01-26 15:21:41.927799","last_active":"2020-01-26 15:21:44.194760","last_peered":"2020-01-26 15:21:44.194760","last_clean":"2020-01-26 15:21:44.194760","last_became_active":"2020-01-26 15:21:41.927403","last_became_peered":"2020-01-26 15:21:41.927403","last_unstale":"2020-01-26 15:21:44.194760","last_undegraded":"2020-01-26 15:21:44.194760","last_fullsized":"2020-01-26 15:21:44.194760","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,1],"acting":[0,1],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.194655","last_change":"2020-01-26 15:21:43.939282","last_active":"2020-01-26 15:21:44.194655","last_peered":"2020-01-26 15:21:44.194655","last_clean":"2020-01-26 15:21:44.194655","last_became_active":"2020-01-26 15:21:43.938954","last_became_peered":"2020-01-26 15:21:43.938954","last_unstale":"2020-01-26 15:21:44.194655","last_undegraded":"2020-01-26 15:21:44.194655","last_fullsized":"2020-01-26 15:21:44.194655","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202785","last_change":"2020-01-26 15:21:44.201926","last_active":"2020-01-26 15:21:44.202785","last_peered":"2020-01-26 15:21:44.202785","last_clean":"2020-01-26 15:21:44.202785","last_became_active":"2020-01-26 15:21:44.201594","last_became_peered":"2020-01-26 15:21:44.201594","last_unstale":"2020-01-26 15:21:44.202785","last_undegraded":"2020-01-26 15:21:44.202785","last_fullsized":"2020-01-26 15:21:44.202785","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198085","last_change":"2020-01-26 15:21:41.925677","last_active":"2020-01-26 15:21:44.198085","last_peered":"2020-01-26 15:21:44.198085","last_clean":"2020-01-26 15:21:44.198085","last_became_active":"2020-01-26 15:21:41.925120","last_became_peered":"2020-01-26 15:21:41.925120","last_unstale":"2020-01-26 15:21:44.198085","last_undegraded":"2020-01-26 15:21:44.198085","last_fullsized":"2020-01-26 15:21:44.198085","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"15","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.827290","last_change":"2020-01-26 15:21:43.943006","last_active":"2020-01-26 15:21:45.827290","last_peered":"2020-01-26 15:21:45.827290","last_clean":"2020-01-26 15:21:45.827290","last_became_active":"2020-01-26 15:21:43.941028","last_became_peered":"2020-01-26 15:21:43.941028","last_unstale":"2020-01-26 15:21:45.827290","last_undegraded":"2020-01-26 15:21:45.827290","last_fullsized":"2020-01-26 15:21:45.827290","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,2],"acting":[3,2],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.198351","last_change":"2020-01-26 15:21:44.197371","last_active":"2020-01-26 15:21:44.198351","last_peered":"2020-01-26 15:21:44.198351","last_clean":"2020-01-26 15:21:44.198351","last_became_active":"2020-01-26 15:21:44.197041","last_became_peered":"2020-01-26 15:21:44.197041","last_unstale":"2020-01-26 15:21:44.198351","last_undegraded":"2020-01-26 15:21:44.198351","last_fullsized":"2020-01-26 15:21:44.198351","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[0,2],"acting":[0,2],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195428","last_change":"2020-01-26 15:21:41.924864","last_active":"2020-01-26 15:21:44.195428","last_peered":"2020-01-26 15:21:44.195428","last_clean":"2020-01-26 15:21:44.195428","last_became_active":"2020-01-26 15:21:41.924454","last_became_peered":"2020-01-26 15:21:41.924454","last_unstale":"2020-01-26 15:21:44.195428","last_undegraded":"2020-01-26 15:21:44.195428","last_fullsized":"2020-01-26 15:21:44.195428","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.815558","last_change":"2020-01-26 15:21:43.939847","last_active":"2020-01-26 15:21:45.815558","last_peered":"2020-01-26 15:21:45.815558","last_clean":"2020-01-26 15:21:45.815558","last_became_active":"2020-01-26 15:21:43.939484","last_became_peered":"2020-01-26 15:21:43.939484","last_unstale":"2020-01-26 15:21:45.815558","last_undegraded":"2020-01-26 15:21:45.815558","last_fullsized":"2020-01-26 15:21:45.815558","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,1],"acting":[3,1],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.202637","last_change":"2020-01-26 15:21:44.202021","last_active":"2020-01-26 15:21:44.202637","last_peered":"2020-01-26 15:21:44.202637","last_clean":"2020-01-26 15:21:44.202637","last_became_active":"2020-01-26 15:21:44.201689","last_became_peered":"2020-01-26 15:21:44.201689","last_unstale":"2020-01-26 15:21:44.202637","last_undegraded":"2020-01-26 15:21:44.202637","last_fullsized":"2020-01-26 15:21:44.202637","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,2],"acting":[1,2],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.195545","last_change":"2020-01-26 15:21:41.928224","last_active":"2020-01-26 15:21:44.195545","last_peered":"2020-01-26 15:21:44.195545","last_clean":"2020-01-26 15:21:44.195545","last_became_active":"2020-01-26 15:21:41.927618","last_became_peered":"2020-01-26 15:21:41.927618","last_unstale":"2020-01-26 15:21:44.195545","last_undegraded":"2020-01-26 15:21:44.195545","last_fullsized":"2020-01-26 15:21:44.195545","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"16","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.826579","last_change":"2020-01-26 15:21:43.943353","last_active":"2020-01-26 15:21:45.826579","last_peered":"2020-01-26 15:21:45.826579","last_clean":"2020-01-26 15:21:45.826579","last_became_active":"2020-01-26 15:21:43.942956","last_became_peered":"2020-01-26 15:21:43.942956","last_unstale":"2020-01-26 15:21:45.826579","last_undegraded":"2020-01-26 15:21:45.826579","last_fullsized":"2020-01-26 15:21:45.826579","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[3,0],"acting":[3,0],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.204505","last_change":"2020-01-26 15:21:44.203122","last_active":"2020-01-26 15:21:44.204505","last_peered":"2020-01-26 15:21:44.204505","last_clean":"2020-01-26 15:21:44.204505","last_became_active":"2020-01-26 15:21:44.202380","last_became_peered":"2020-01-26 15:21:44.202380","last_unstale":"2020-01-26 15:21:44.204505","last_undegraded":"2020-01-26 15:21:44.204505","last_fullsized":"2020-01-26 15:21:44.204505","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:43.926777","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:43.926777","last_clean_scrub_stamp":"2020-01-26 15:21:43.926777","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[2,3],"acting":[2,3],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"12","reported_epoch":"14","state":"active+clean","last_fresh":"2020-01-26 15:21:44.199084","last_change":"2020-01-26 15:21:41.928890","last_active":"2020-01-26 15:21:44.199084","last_peered":"2020-01-26 15:21:44.199084","last_clean":"2020-01-26 15:21:44.199084","last_became_active":"2020-01-26 15:21:41.927480","last_became_peered":"2020-01-26 15:21:41.927480","last_unstale":"2020-01-26 15:21:44.199084","last_undegraded":"2020-01-26 15:21:44.199084","last_fullsized":"2020-01-26 15:21:44.199084","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:40.897075","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:40.897075","last_clean_scrub_stamp":"2020-01-26 15:21:40.897075","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,3],"acting":[1,3],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"15'8","reported_seq":"18","reported_epoch":"15","state":"active+clean","last_fresh":"2020-01-26 15:21:45.826519","last_change":"2020-01-26 15:21:43.942785","last_active":"2020-01-26 15:21:45.826519","last_peered":"2020-01-26 15:21:45.826519","last_clean":"2020-01-26 15:21:45.826519","last_became_active":"2020-01-26 15:21:43.942416","last_became_peered":"2020-01-26 15:21:43.942416","last_unstale":"2020-01-26 15:21:45.826519","last_undegraded":"2020-01-26 15:21:45.826519","last_fullsized":"2020-01-26 15:21:45.826519","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26 15:21:42.921661","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26 15:21:42.921661","last_clean_scrub_stamp":"2020-01-26 15:21:42.921661","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"up":[1,0],"acting":[1,0],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":14,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.537}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.310}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.583}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":2,"kb":94371840,"kb_used":1049104,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322736,"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.578}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.657}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.549}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":5,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.450}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.542}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.375}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":12,"kb":94371840,"kb_used":1049136,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322704,"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0.000000,"apply_latency_ms":0.000000,"commit_latency_ns":0,"apply_latency_ns":0},"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.293}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.352}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.376}]}]}]} 2020-01-26T15:21:50.305 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:21:50.305 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:21:50.306 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:21:50.306 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:21:50.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 Processor -- start 2020-01-26T15:21:50.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- - start start 2020-01-26T15:21:50.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e014bb00 con 0 2020-01-26T15:21:50.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e014bea0 con 0 2020-01-26T15:21:50.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dea68700 1 -- 172.21.15.129:0/3766812306 learned_addr learned my addr 172.21.15.129:0/3766812306 2020-01-26T15:21:50.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1c80022a0 con 0x7ff1e014b3c0 2020-01-26T15:21:50.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2409783085 0 0) 0x7ff1c8002620 con 0x7ff1e014b3c0 2020-01-26T15:21:50.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1c0002a20 con 0 2020-01-26T15:21:50.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1d00039b0 con 0x7ff1e01480c0 2020-01-26T15:21:50.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1873481701 0 0) 0x7ff1d0003d30 con 0x7ff1e01480c0 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1c00046b0 con 0 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4028499307 0 0) 0x7ff1c8002bf0 con 0x7ff1e014b3c0 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 >> 172.21.15.129:6790/0 conn(0x7ff1e01480c0 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e007a920 con 0 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff1e0116e70 con 0x7ff1e014b3c0 2020-01-26T15:21:50.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1dda66700 1 -- 172.21.15.129:0/3766812306 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1c8001050 con 0x7ff1e014b3c0 2020-01-26T15:21:50.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- 172.21.15.129:0/3766812306 >> 172.21.15.129:6791/0 conn(0x7ff1e014b3c0 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:21:50.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- 172.21.15.129:0/3766812306 shutdown_connections 2020-01-26T15:21:50.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- 172.21.15.129:0/3766812306 shutdown_connections 2020-01-26T15:21:50.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- 172.21.15.129:0/3766812306 wait complete. 2020-01-26T15:21:50.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.394 7ff1e4cc7700 1 -- 172.21.15.129:0/3766812306 >> 172.21.15.129:0/3766812306 conn(0x7ff1e0143ff0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 Processor -- start 2020-01-26T15:21:50.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 -- - start start 2020-01-26T15:21:50.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00a3d70 con 0 2020-01-26T15:21:50.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00a5220 con 0 2020-01-26T15:21:50.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1de267700 1 -- 172.21.15.129:0/1170102818 learned_addr learned my addr 172.21.15.129:0/1170102818 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1d00037f0 con 0x7ff1e00a3470 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1c8001010 con 0x7ff1e0095cc0 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1263964746 0 0) 0x7ff1d00040c0 con 0x7ff1e00a3470 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1c4002df0 con 0 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3202223745 0 0) 0x7ff1c8001ff0 con 0x7ff1e0095cc0 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff1c4004620 con 0 2020-01-26T15:21:50.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2020261904 0 0) 0x7ff1d0004330 con 0x7ff1e00a3470 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1c4004df0 con 0 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3371138871 0 0) 0x7ff1c8002490 con 0x7ff1e0095cc0 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1c4006570 con 0 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1179607963 0 0) 0x7ff1d0001470 con 0x7ff1e00a3470 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 >> 172.21.15.129:6790/0 conn(0x7ff1e0095cc0 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e007ab80 con 0 2020-01-26T15:21:50.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e00712e0 con 0 2020-01-26T15:21:50.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e00a6cb0 con 0 2020-01-26T15:21:50.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff1e00e9fe0 con 0x7ff1e00a3470 2020-01-26T15:21:50.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff1d00018a0 con 0x7ff1e00a3470 2020-01-26T15:21:50.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7ff1d00045e0 con 0x7ff1e00a3470 2020-01-26T15:21:50.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.398 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7ff1d0006260 con 0x7ff1e00a3470 2020-01-26T15:21:50.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.406 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b8002070 con 0 2020-01-26T15:21:50.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.414 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff1d0001d90 con 0x7ff1e00a3470 2020-01-26T15:21:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff1b80011d0 con 0 2020-01-26T15:21:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1d7fff700 1 -- 172.21.15.129:0/1170102818 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+65 (3730786198 0 590078407) 0x7ff1d0004d10 con 0x7ff1e00a3470 2020-01-26T15:21:50.504 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:50.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 >> 172.21.15.129:6800/11038 conn(0x7ff1c40072a0 :-1 s=STATE_OPEN pgs=57 cs=1 l=1).mark_down 2020-01-26T15:21:50.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 >> 172.21.15.129:6791/0 conn(0x7ff1e00a3470 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:21:50.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 shutdown_connections 2020-01-26T15:21:50.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 shutdown_connections 2020-01-26T15:21:50.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 wait complete. 2020-01-26T15:21:50.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.502 7ff1e4cc7700 1 -- 172.21.15.129:0/1170102818 >> 172.21.15.129:0/1170102818 conn(0x7ff1e0099560 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.515 INFO:teuthology.orchestra.run.smithi129.stdout:{"checks":{},"status":"HEALTH_OK","overall_status":"HEALTH_WARN"} 2020-01-26T15:21:50.515 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-01-26T15:21:50.516 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:50.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c74b5e700 1 Processor -- start 2020-01-26T15:21:50.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c74b5e700 1 -- - start start 2020-01-26T15:21:50.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c74b5e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7014bb10 con 0 2020-01-26T15:21:50.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c74b5e700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7014beb0 con 0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6e267700 1 -- 172.21.15.129:0/3036142178 learned_addr learned my addr 172.21.15.129:0/3036142178 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c60002620 con 0x7f8c701480d0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1482821393 0 0) 0x7f8c600029a0 con 0x7f8c701480d0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8c50002a20 con 0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c58003630 con 0x7f8c7014b3d0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4204142865 0 0) 0x7f8c58003930 con 0x7f8c7014b3d0 2020-01-26T15:21:50.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8c500046c0 con 0 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2642577376 0 0) 0x7f8c60002f70 con 0x7f8c701480d0 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 >> 172.21.15.129:6789/0 conn(0x7f8c7014b3d0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7007a930 con 0 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8c700e9ff0 con 0x7f8c701480d0 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c6da66700 1 -- 172.21.15.129:0/3036142178 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c600013d0 con 0x7f8c701480d0 2020-01-26T15:21:50.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.606 7f8c74b5e700 1 -- 172.21.15.129:0/3036142178 >> 172.21.15.129:6791/0 conn(0x7f8c701480d0 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:21:50.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3036142178 shutdown_connections 2020-01-26T15:21:50.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3036142178 shutdown_connections 2020-01-26T15:21:50.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3036142178 wait complete. 2020-01-26T15:21:50.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3036142178 >> 172.21.15.129:0/3036142178 conn(0x7f8c70144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 Processor -- start 2020-01-26T15:21:50.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- - start start 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c700a3d90 con 0 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c70095e00 con 0 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c6ea68700 1 -- 172.21.15.129:0/3468612662 learned_addr learned my addr 172.21.15.129:0/3468612662 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c60001390 con 0x7f8c700a33a0 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c58003e70 con 0x7f8c700a5150 2020-01-26T15:21:50.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2330547517 0 0) 0x7f8c60002370 con 0x7f8c700a33a0 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8c54002df0 con 0 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (97281245 0 0) 0x7f8c58003470 con 0x7f8c700a5150 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f8c54004620 con 0 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (745277166 0 0) 0x7f8c58003800 con 0x7f8c700a5150 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c54004df0 con 0 2020-01-26T15:21:50.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (45814633 0 0) 0x7f8c60002810 con 0x7f8c700a33a0 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c540034b0 con 0 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (135839872 0 0) 0x7f8c580010f0 con 0x7f8c700a5150 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 >> 172.21.15.129:6791/0 conn(0x7f8c700a33a0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7007ab90 con 0 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c700b2970 con 0 2020-01-26T15:21:50.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f8c70116e80 con 0x7f8c700a5150 2020-01-26T15:21:50.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.610 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c700a6bd0 con 0 2020-01-26T15:21:50.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.614 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f8c58001520 con 0x7f8c700a5150 2020-01-26T15:21:50.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.614 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f8c58004260 con 0x7f8c700a5150 2020-01-26T15:21:50.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.614 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f8c58004c50 con 0x7f8c700a5150 2020-01-26T15:21:50.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.622 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7007af30 con 0 2020-01-26T15:21:50.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.622 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f8c7007af30 con 0x7f8c700a5150 2020-01-26T15:21:50.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.714 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c701563d0 con 0 2020-01-26T15:21:50.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c67fff700 1 -- 172.21.15.129:0/3468612662 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+6330 (4221056075 0 1195610651) 0x7f8c58004540 con 0x7f8c700a5150 2020-01-26T15:21:50.719 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:50.719 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":15,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:45.190225","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:50.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 >> 172.21.15.129:6800/11038 conn(0x7f8c540072a0 :-1 s=STATE_OPEN pgs=58 cs=1 l=1).mark_down 2020-01-26T15:21:50.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 >> 172.21.15.129:6789/0 conn(0x7f8c700a5150 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:21:50.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 shutdown_connections 2020-01-26T15:21:50.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 shutdown_connections 2020-01-26T15:21:50.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 wait complete. 2020-01-26T15:21:50.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.718 7f8c74b5e700 1 -- 172.21.15.129:0/3468612662 >> 172.21.15.129:0/3468612662 conn(0x7f8c70099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.730 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:42.851862', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:43.236142', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:50.731 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:50.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de9bae700 1 Processor -- start 2020-01-26T15:21:50.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de9bae700 1 -- - start start 2020-01-26T15:21:50.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de9bae700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de414bb50 con 0 2020-01-26T15:21:50.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de9bae700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de414bef0 con 0 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de37fe700 1 -- 172.21.15.129:0/2973924151 learned_addr learned my addr 172.21.15.129:0/2973924151 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5dcc003630 con 0x7f5de4148110 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1325856550 0 0) 0x7f5dcc0039b0 con 0x7f5de4148110 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dc4002a20 con 0 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5ddc002620 con 0x7f5de414b410 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1608834630 0 0) 0x7f5ddc0029a0 con 0x7f5de414b410 2020-01-26T15:21:50.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dc40046c0 con 0 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4150443029 0 0) 0x7f5dcc003eb0 con 0x7f5de4148110 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 >> 172.21.15.129:6791/0 conn(0x7f5de414b410 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de407a8b0 con 0 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5de40ea030 con 0x7f5de4148110 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de27fc700 1 -- 172.21.15.129:0/2973924151 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5dcc001010 con 0x7f5de4148110 2020-01-26T15:21:50.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.826 7f5de9bae700 1 -- 172.21.15.129:0/2973924151 >> 172.21.15.129:6790/0 conn(0x7f5de4148110 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:21:50.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- 172.21.15.129:0/2973924151 shutdown_connections 2020-01-26T15:21:50.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- 172.21.15.129:0/2973924151 shutdown_connections 2020-01-26T15:21:50.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- 172.21.15.129:0/2973924151 wait complete. 2020-01-26T15:21:50.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- 172.21.15.129:0/2973924151 >> 172.21.15.129:0/2973924151 conn(0x7f5de4144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 Processor -- start 2020-01-26T15:21:50.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- - start start 2020-01-26T15:21:50.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40a3cb0 con 0 2020-01-26T15:21:50.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de9bae700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40a6a80 con 0 2020-01-26T15:21:50.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de2ffd700 1 -- 172.21.15.129:0/1856156720 learned_addr learned my addr 172.21.15.129:0/1856156720 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5ddc002620 con 0x7f5de40a62d0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2258007483 0 0) 0x7f5ddc002d30 con 0x7f5de40a62d0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dc8002960 con 0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5dcc000e50 con 0x7f5de40a32c0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (628628992 0 0) 0x7f5dcc001530 con 0x7f5de40a32c0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f5dc8004620 con 0 2020-01-26T15:21:50.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.830 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3372650953 0 0) 0x7f5dcc0018b0 con 0x7f5de40a32c0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5dc8002ee0 con 0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1563151395 0 0) 0x7f5ddc0011d0 con 0x7f5de40a62d0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5dc8003540 con 0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (182301193 0 0) 0x7f5dcc003380 con 0x7f5de40a32c0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 >> 172.21.15.129:6790/0 conn(0x7f5de40a62d0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de407ab10 con 0 2020-01-26T15:21:50.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de40b2900 con 0 2020-01-26T15:21:50.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de418b220 con 0 2020-01-26T15:21:50.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f5dcc001320 con 0x7f5de40a32c0 2020-01-26T15:21:50.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f5dcc0037b0 con 0x7f5de40a32c0 2020-01-26T15:21:50.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f5dcc0045c0 con 0x7f5de40a32c0 2020-01-26T15:21:50.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.834 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f5dcc004a30 con 0x7f5de40a32c0 2020-01-26T15:21:50.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.842 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc002070 con 0 2020-01-26T15:21:50.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.846 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f5dcc0040a0 con 0x7f5de40a32c0 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f5dbc001270 con 0 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de0ff9700 1 -- 172.21.15.129:0/1856156720 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v15) v1 ==== 92+0+10 (4292913633 0 265718887) 0x7f5dcc0050f0 con 0x7f5de40a32c0 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 >> 172.21.15.129:6800/11038 conn(0x7f5dc8006ed0 :-1 s=STATE_OPEN pgs=59 cs=1 l=1).mark_down 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 >> 172.21.15.129:6789/0 conn(0x7f5de40a32c0 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 shutdown_connections 2020-01-26T15:21:50.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 shutdown_connections 2020-01-26T15:21:50.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 wait complete. 2020-01-26T15:21:50.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:50.938 7f5de9bae700 1 -- 172.21.15.129:0/1856156720 >> 172.21.15.129:0/1856156720 conn(0x7f5de4099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:50.944 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:50.955 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:21:51.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82cd333700 1 Processor -- start 2020-01-26T15:21:51.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82cd333700 1 -- - start start 2020-01-26T15:21:51.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82cd333700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c814bb50 con 0 2020-01-26T15:21:51.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82cd333700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c814bef0 con 0 2020-01-26T15:21:51.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c7269700 1 -- 172.21.15.129:0/3863894849 learned_addr learned my addr 172.21.15.129:0/3863894849 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82bc0022a0 con 0x7f82c814b410 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3941378653 0 0) 0x7f82bc002620 con 0x7f82c814b410 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82b4002a20 con 0 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82b8003630 con 0x7f82c8148110 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (609238447 0 0) 0x7f82b80039b0 con 0x7f82c8148110 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.050 7f82c6267700 1 -- 172.21.15.129:0/3863894849 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82b40046c0 con 0 2020-01-26T15:21:51.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1519431110 0 0) 0x7f82b8003e50 con 0x7f82c8148110 2020-01-26T15:21:51.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6267700 1 -- 172.21.15.129:0/3863894849 >> 172.21.15.129:6791/0 conn(0x7f82c814b410 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:21:51.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6267700 1 -- 172.21.15.129:0/3863894849 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c807a8b0 con 0 2020-01-26T15:21:51.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f82c80ea030 con 0x7f82c8148110 2020-01-26T15:21:51.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6267700 1 -- 172.21.15.129:0/3863894849 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82b8001010 con 0x7f82c8148110 2020-01-26T15:21:51.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- 172.21.15.129:0/3863894849 >> 172.21.15.129:6789/0 conn(0x7f82c8148110 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:21:51.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- 172.21.15.129:0/3863894849 shutdown_connections 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- 172.21.15.129:0/3863894849 shutdown_connections 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- 172.21.15.129:0/3863894849 wait complete. 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- 172.21.15.129:0/3863894849 >> 172.21.15.129:0/3863894849 conn(0x7f82c8144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 Processor -- start 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- - start start 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80a3ca0 con 0 2020-01-26T15:21:51.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82cd333700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80a5150 con 0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c6a68700 1 -- 172.21.15.129:0/36801438 learned_addr learned my addr 172.21.15.129:0/36801438 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82bc002270 con 0x7f82c8095be0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1315995677 0 0) 0x7f82bc002570 con 0x7f82c8095be0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c4a64700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82a8002960 con 0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82b8000e50 con 0x7f82c80a33a0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.054 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2635171348 0 0) 0x7f82b8003410 con 0x7f82c80a33a0 2020-01-26T15:21:51.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f82a8004620 con 0 2020-01-26T15:21:51.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2592111618 0 0) 0x7f82bc000e50 con 0x7f82c8095be0 2020-01-26T15:21:51.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82a8002ee0 con 0 2020-01-26T15:21:51.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (151299286 0 0) 0x7f82bc001540 con 0x7f82c8095be0 2020-01-26T15:21:51.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 >> 172.21.15.129:6789/0 conn(0x7f82c80a33a0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c807ab10 con 0 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82cd333700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c80b26e0 con 0 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82cd333700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80a6b40 con 0 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f82bc000bf0 con 0x7f82c8095be0 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f82bc001970 con 0x7f82c8095be0 2020-01-26T15:21:51.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f82bc001bb0 con 0x7f82c8095be0 2020-01-26T15:21:51.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.058 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f82bc005d30 con 0x7f82c8095be0 2020-01-26T15:21:51.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.062 7f82cd333700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a4002070 con 0 2020-01-26T15:21:51.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.070 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f82bc004940 con 0x7f82c8095be0 2020-01-26T15:21:51.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.158 7f82cd333700 1 -- 172.21.15.129:0/36801438 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f82a40012a0 con 0 2020-01-26T15:21:51.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.158 7f82c4a64700 1 -- 172.21.15.129:0/36801438 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v15) v1 ==== 104+0+10 (3116399402 0 265718887) 0x7f82bc004050 con 0x7f82c8095be0 2020-01-26T15:21:51.161 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:51.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 >> 172.21.15.129:6800/11038 conn(0x7f82a80065f0 :-1 s=STATE_OPEN pgs=60 cs=1 l=1).mark_down 2020-01-26T15:21:51.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 >> 172.21.15.129:6791/0 conn(0x7f82c8095be0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:21:51.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 shutdown_connections 2020-01-26T15:21:51.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 shutdown_connections 2020-01-26T15:21:51.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 wait complete. 2020-01-26T15:21:51.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.162 7f82cd333700 1 -- 172.21.15.129:0/36801438 >> 172.21.15.129:0/36801438 conn(0x7f82c80994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.172 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:21:51.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.262 7f0047921700 1 Processor -- start 2020-01-26T15:21:51.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.262 7f0047921700 1 -- - start start 2020-01-26T15:21:51.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004014bb50 con 0 2020-01-26T15:21:51.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004014bef0 con 0 2020-01-26T15:21:51.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0045146700 1 -- 172.21.15.129:0/10128700 learned_addr learned my addr 172.21.15.129:0/10128700 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0034003630 con 0x7f004014b410 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2743150099 0 0) 0x7f00340039b0 con 0x7f004014b410 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f002c002a20 con 0 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f00300022a0 con 0x7f0040148110 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3377581367 0 0) 0x7f00300025a0 con 0x7f0040148110 2020-01-26T15:21:51.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f002c0046c0 con 0 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3666577043 0 0) 0x7f0034003f80 con 0x7f004014b410 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 >> 172.21.15.129:6791/0 conn(0x7f0040148110 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004007a8b0 con 0 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f0034000bf0 con 0x7f004014b410 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0044945700 1 -- 172.21.15.129:0/10128700 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0034001050 con 0x7f004014b410 2020-01-26T15:21:51.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- 172.21.15.129:0/10128700 >> 172.21.15.129:6789/0 conn(0x7f004014b410 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:21:51.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- 172.21.15.129:0/10128700 shutdown_connections 2020-01-26T15:21:51.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- 172.21.15.129:0/10128700 shutdown_connections 2020-01-26T15:21:51.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- 172.21.15.129:0/10128700 wait complete. 2020-01-26T15:21:51.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.266 7f0047921700 1 -- 172.21.15.129:0/10128700 >> 172.21.15.129:0/10128700 conn(0x7f0040144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 Processor -- start 2020-01-26T15:21:51.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 -- - start start 2020-01-26T15:21:51.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400a3e70 con 0 2020-01-26T15:21:51.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0040092b70 con 0 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0045947700 1 -- 172.21.15.129:0/1822977877 learned_addr learned my addr 172.21.15.129:0/1822977877 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0034003f80 con 0x7f00400a5230 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2651056026 0 0) 0x7f0034000ed0 con 0x7f00400a5230 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0020002960 con 0 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f00300020e0 con 0x7f00400a3480 2020-01-26T15:21:51.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2786936301 0 0) 0x7f00300023e0 con 0x7f00400a3480 2020-01-26T15:21:51.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f0020004620 con 0 2020-01-26T15:21:51.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1131378865 0 0) 0x7f0030000e50 con 0x7f00400a3480 2020-01-26T15:21:51.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0020002ee0 con 0 2020-01-26T15:21:51.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2243481288 0 0) 0x7f00340034a0 con 0x7f00400a5230 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0020003540 con 0 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (915695084 0 0) 0x7f0030001390 con 0x7f00400a3480 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 >> 172.21.15.129:6790/0 conn(0x7f00400a5230 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004007ab10 con 0 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00400711d0 con 0 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f0047921700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400a6d00 con 0 2020-01-26T15:21:51.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f00400ea030 con 0x7f00400a3480 2020-01-26T15:21:51.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f0030001600 con 0x7f00400a3480 2020-01-26T15:21:51.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f0030003f90 con 0x7f00400a3480 2020-01-26T15:21:51.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.270 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f0030005b90 con 0x7f00400a3480 2020-01-26T15:21:51.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.278 7f0047921700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c002070 con 0 2020-01-26T15:21:51.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.286 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f0030001840 con 0x7f00400a3480 2020-01-26T15:21:51.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.374 7f0047921700 1 -- 172.21.15.129:0/1822977877 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f001c0012a0 con 0 2020-01-26T15:21:51.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.374 7f003effd700 1 -- 172.21.15.129:0/1822977877 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v15) v1 ==== 100+0+10 (3921105427 0 265718887) 0x7f0030004c00 con 0x7f00400a3480 2020-01-26T15:21:51.377 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:51.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 >> 172.21.15.129:6800/11038 conn(0x7f0020006ed0 :-1 s=STATE_OPEN pgs=61 cs=1 l=1).mark_down 2020-01-26T15:21:51.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 >> 172.21.15.129:6791/0 conn(0x7f00400a3480 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:21:51.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 shutdown_connections 2020-01-26T15:21:51.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 shutdown_connections 2020-01-26T15:21:51.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 wait complete. 2020-01-26T15:21:51.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.378 7f0047921700 1 -- 172.21.15.129:0/1822977877 >> 172.21.15.129:0/1822977877 conn(0x7f0040099660 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.388 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:21:51.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.478 7f3bc64c1700 1 Processor -- start 2020-01-26T15:21:51.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.478 7f3bc64c1700 1 -- - start start 2020-01-26T15:21:51.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc014bb10 con 0 2020-01-26T15:21:51.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc014beb0 con 0 2020-01-26T15:21:51.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbf7fe700 1 -- 172.21.15.129:0/1668490438 learned_addr learned my addr 172.21.15.129:0/1668490438 2020-01-26T15:21:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb00022a0 con 0x7f3bc01480d0 2020-01-26T15:21:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3638075057 0 0) 0x7f3bb0002620 con 0x7f3bc01480d0 2020-01-26T15:21:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bac002a20 con 0 2020-01-26T15:21:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb4003630 con 0x7f3bc014b3d0 2020-01-26T15:21:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3961643446 0 0) 0x7f3bb4003930 con 0x7f3bc014b3d0 2020-01-26T15:21:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3bac0046c0 con 0 2020-01-26T15:21:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3323312942 0 0) 0x7f3bb0002bf0 con 0x7f3bc01480d0 2020-01-26T15:21:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 >> 172.21.15.129:6791/0 conn(0x7f3bc014b3d0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:21:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc007a930 con 0 2020-01-26T15:21:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3bc00e9ff0 con 0x7f3bc01480d0 2020-01-26T15:21:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bbeffd700 1 -- 172.21.15.129:0/1668490438 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb0001050 con 0x7f3bc01480d0 2020-01-26T15:21:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- 172.21.15.129:0/1668490438 >> 172.21.15.129:6790/0 conn(0x7f3bc01480d0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:21:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- 172.21.15.129:0/1668490438 shutdown_connections 2020-01-26T15:21:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- 172.21.15.129:0/1668490438 shutdown_connections 2020-01-26T15:21:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- 172.21.15.129:0/1668490438 wait complete. 2020-01-26T15:21:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.482 7f3bc64c1700 1 -- 172.21.15.129:0/1668490438 >> 172.21.15.129:0/1668490438 conn(0x7f3bc0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 Processor -- start 2020-01-26T15:21:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 -- - start start 2020-01-26T15:21:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00a3d50 con 0 2020-01-26T15:21:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00a5200 con 0 2020-01-26T15:21:51.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbffff700 1 -- 172.21.15.129:0/1910934713 learned_addr learned my addr 172.21.15.129:0/1910934713 2020-01-26T15:21:51.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb0001010 con 0x7f3bc00a3450 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2644568645 0 0) 0x7f3bb0002070 con 0x7f3bc00a3450 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ba0002960 con 0 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb4003e70 con 0x7f3bc0095cd0 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3670851417 0 0) 0x7f3bb4003470 con 0x7f3bc0095cd0 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f3ba0004620 con 0 2020-01-26T15:21:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (284427143 0 0) 0x7f3bb00025e0 con 0x7f3bc00a3450 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ba0002ee0 con 0 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (129566672 0 0) 0x7f3bb40036e0 con 0x7f3bc0095cd0 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ba0003540 con 0 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (444797887 0 0) 0x7f3bb0001960 con 0x7f3bc00a3450 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 >> 172.21.15.129:6791/0 conn(0x7f3bc0095cd0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc007ab90 con 0 2020-01-26T15:21:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc00b27b0 con 0 2020-01-26T15:21:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00a6c90 con 0 2020-01-26T15:21:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f3bb0000bf0 con 0x7f3bc00a3450 2020-01-26T15:21:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f3bb0002ed0 con 0x7f3bc00a3450 2020-01-26T15:21:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f3bb0003630 con 0x7f3bc00a3450 2020-01-26T15:21:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.486 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f3bb0003110 con 0x7f3bc00a3450 2020-01-26T15:21:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.494 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c002070 con 0 2020-01-26T15:21:51.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.498 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f3bb0018040 con 0x7f3bc00a3450 2020-01-26T15:21:51.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.586 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b9c0011d0 con 0 2020-01-26T15:21:51.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.586 7f3bbd7fa700 1 -- 172.21.15.129:0/1910934713 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2250 (3717936808 0 1722169651) 0x7f3bb00058e0 con 0x7f3bc00a3450 2020-01-26T15:21:51.590 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 5 2020-01-26T15:21:51.590 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:51.591 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:21:46.806578","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 >> 172.21.15.129:6800/11038 conn(0x7f3ba0006ed0 :-1 s=STATE_OPEN pgs=62 cs=1 l=1).mark_down 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 >> 172.21.15.129:6790/0 conn(0x7f3bc00a3450 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 shutdown_connections 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 shutdown_connections 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 wait complete. 2020-01-26T15:21:51.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:51.590 7f3bc64c1700 1 -- 172.21.15.129:0/1910934713 >> 172.21.15.129:0/1910934713 conn(0x7f3bc0099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:51.907 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4209}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4209': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 4, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4209, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.129:6819/2338999715'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:21:44.187366', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:21:46.806578', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:21:51.907 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:21:51.908 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:21:51.992 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:21:51.992 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "whoami": 0, 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4209, 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "want_state": "up:active", 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "state": "up:active", 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "rank_uptime": 6.186830, 2020-01-26T15:21:51.993 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 5, 2020-01-26T15:21:51.994 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch": 15, 2020-01-26T15:21:51.994 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch_barrier": 15, 2020-01-26T15:21:51.994 INFO:teuthology.orchestra.run.smithi129.stdout: "uptime": 6.228245 2020-01-26T15:21:51.994 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:21:51.999 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", "whoami": 0, "id": 4209, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.186830, "mdsmap_epoch": 5, "osdmap_epoch": 15, "osdmap_epoch_barrier": 15, "uptime": 6.228245 } 2020-01-26T15:21:51.999 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:21:52.009 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:21:52.009 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:21:52.010 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client mimic' 2020-01-26T15:21:52.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53eb729700 1 Processor -- start 2020-01-26T15:21:52.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53eb729700 1 -- - start start 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53eb729700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e414bc60 con 0 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53eb729700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e414c000 con 0 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53e974f700 1 -- 172.21.15.129:0/3258427338 learned_addr learned my addr 172.21.15.129:0/3258427338 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53e0003630 con 0x7f53e41481d0 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4077002164 0 0) 0x7f53e00039b0 con 0x7f53e41481d0 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f53c8002a20 con 0 2020-01-26T15:21:52.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53d40022a0 con 0x7f53e414b4d0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3336679623 0 0) 0x7f53d4002620 con 0x7f53e414b4d0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f53c80046c0 con 0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4244108182 0 0) 0x7f53e0003eb0 con 0x7f53e41481d0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 >> 172.21.15.129:6789/0 conn(0x7f53e414b4d0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e407aae0 con 0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f53e40ea0f0 con 0x7f53e41481d0 2020-01-26T15:21:52.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53dbfff700 1 -- 172.21.15.129:0/3258427338 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53e0001010 con 0x7f53e41481d0 2020-01-26T15:21:52.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.098 7f53eb729700 1 -- 172.21.15.129:0/3258427338 >> 172.21.15.129:6791/0 conn(0x7f53e41481d0 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:21:52.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.102 7f53eb729700 1 -- 172.21.15.129:0/3258427338 shutdown_connections 2020-01-26T15:21:52.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.102 7f53eb729700 1 -- 172.21.15.129:0/3258427338 shutdown_connections 2020-01-26T15:21:52.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.102 7f53eb729700 1 -- 172.21.15.129:0/3258427338 wait complete. 2020-01-26T15:21:52.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.102 7f53eb729700 1 -- 172.21.15.129:0/3258427338 >> 172.21.15.129:0/3258427338 conn(0x7f53e4144100 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 Processor -- start 2020-01-26T15:21:52.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 -- - start start 2020-01-26T15:21:52.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e40a3eb0 con 0 2020-01-26T15:21:52.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e40a6c30 con 0 2020-01-26T15:21:52.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53e8f4e700 1 -- 172.21.15.129:0/2817022816 learned_addr learned my addr 172.21.15.129:0/2817022816 2020-01-26T15:21:52.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53e0000e50 con 0x7f53e40a3470 2020-01-26T15:21:52.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3097259754 0 0) 0x7f53e0001530 con 0x7f53e40a3470 2020-01-26T15:21:52.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f53cc002960 con 0 2020-01-26T15:21:52.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53d40022a0 con 0x7f53e40a6480 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3146446344 0 0) 0x7f53d40029b0 con 0x7f53e40a6480 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f53cc004620 con 0 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4215391988 0 0) 0x7f53e0001980 con 0x7f53e40a3470 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f53cc002ee0 con 0 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2358531987 0 0) 0x7f53d4000e50 con 0x7f53e40a6480 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f53cc003540 con 0 2020-01-26T15:21:52.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2914478377 0 0) 0x7f53d4001360 con 0x7f53e40a6480 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 >> 172.21.15.129:6789/0 conn(0x7f53e40a3470 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e407ad40 con 0 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40b2a80 con 0 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53eb729700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e418b380 con 0 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f53e4116f80 con 0x7f53e40a6480 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f53d4001790 con 0x7f53e40a6480 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f53d40019d0 con 0x7f53e40a6480 2020-01-26T15:21:52.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.106 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 2811+0+0 (3647715926 0 0) 0x7f53d4005b50 con 0x7f53e40a6480 2020-01-26T15:21:52.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.110 7f53eb729700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e407b0a0 con 0 2020-01-26T15:21:52.117 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.114 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f53e407b0a0 con 0x7f53e40a6480 2020-01-26T15:21:52.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.210 7f53eb729700 1 -- 172.21.15.129:0/2817022816 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "mimic"} v 0) v1 -- 0x7f53e4073440 con 0 2020-01-26T15:21:52.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.218 7f53da7fc700 1 -- 172.21.15.129:0/2817022816 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "mimic"}]=0 set require_min_compat_client to mimic v16) v1 ==== 139+0+0 (328287143 0 0) 0x7f53d40043d0 con 0x7f53e40a6480 2020-01-26T15:21:52.227 INFO:teuthology.orchestra.run.smithi129.stderr:set require_min_compat_client to mimic 2020-01-26T15:21:52.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 >> 172.21.15.129:6800/11038 conn(0x7f53cc006e70 :-1 s=STATE_OPEN pgs=63 cs=1 l=1).mark_down 2020-01-26T15:21:52.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 >> 172.21.15.129:6790/0 conn(0x7f53e40a6480 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:21:52.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 shutdown_connections 2020-01-26T15:21:52.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 shutdown_connections 2020-01-26T15:21:52.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 wait complete. 2020-01-26T15:21:52.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.226 7f53eb729700 1 -- 172.21.15.129:0/2817022816 >> 172.21.15.129:0/2817022816 conn(0x7f53e40995c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.240 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:21:52.252 INFO:teuthology.task.print:**** done ceph 2020-01-26T15:21:52.252 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-01-26T15:21:52.273 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-01-26T15:21:52.274 INFO:tasks.ceph_fuse:config is None 2020-01-26T15:21:52.274 INFO:tasks.ceph_fuse:new config is {'client.1': None, 'client.0': None} 2020-01-26T15:21:52.274 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-01-26T15:21:52.274 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:52.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.366 7f64ebb57700 1 Processor -- start 2020-01-26T15:21:52.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.366 7f64ebb57700 1 -- - start start 2020-01-26T15:21:52.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.366 7f64ebb57700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e414bb10 con 0 2020-01-26T15:21:52.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.366 7f64ebb57700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e414beb0 con 0 2020-01-26T15:21:52.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e9b7d700 1 -- 172.21.15.129:0/3685763496 learned_addr learned my addr 172.21.15.129:0/3685763496 2020-01-26T15:21:52.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64e0003630 con 0x7f64e41480d0 2020-01-26T15:21:52.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1184431614 0 0) 0x7f64e00039b0 con 0x7f64e41480d0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f64cc002a20 con 0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64d40022a0 con 0x7f64e414b3d0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4024644290 0 0) 0x7f64d4002620 con 0x7f64e414b3d0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f64cc0046c0 con 0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (925317417 0 0) 0x7f64e0003f80 con 0x7f64e41480d0 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 >> 172.21.15.129:6789/0 conn(0x7f64e414b3d0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:21:52.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e407a930 con 0 2020-01-26T15:21:52.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f64e40e9ff0 con 0x7f64e41480d0 2020-01-26T15:21:52.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64e8b7b700 1 -- 172.21.15.129:0/3685763496 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64e0001050 con 0x7f64e41480d0 2020-01-26T15:21:52.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64ebb57700 1 -- 172.21.15.129:0/3685763496 >> 172.21.15.129:6790/0 conn(0x7f64e41480d0 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:21:52.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64ebb57700 1 -- 172.21.15.129:0/3685763496 shutdown_connections 2020-01-26T15:21:52.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64ebb57700 1 -- 172.21.15.129:0/3685763496 shutdown_connections 2020-01-26T15:21:52.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64ebb57700 1 -- 172.21.15.129:0/3685763496 wait complete. 2020-01-26T15:21:52.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.370 7f64ebb57700 1 -- 172.21.15.129:0/3685763496 >> 172.21.15.129:0/3685763496 conn(0x7f64e4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 Processor -- start 2020-01-26T15:21:52.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 -- - start start 2020-01-26T15:21:52.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40a3d30 con 0 2020-01-26T15:21:52.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40a51e0 con 0 2020-01-26T15:21:52.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64e9b7d700 1 -- 172.21.15.129:0/4047855245 learned_addr learned my addr 172.21.15.129:0/4047855245 2020-01-26T15:21:52.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64d4002b60 con 0x7f64e4095c70 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3455773022 0 0) 0x7f64d4002130 con 0x7f64e4095c70 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f64c4002960 con 0 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64e0000e50 con 0x7f64e40a3430 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (651977400 0 0) 0x7f64e0001570 con 0x7f64e40a3430 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f64c4004620 con 0 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2556093027 0 0) 0x7f64d4000e50 con 0x7f64e4095c70 2020-01-26T15:21:52.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64c4002ee0 con 0 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4109244571 0 0) 0x7f64e00018f0 con 0x7f64e40a3430 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64c4003540 con 0 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4262085156 0 0) 0x7f64d4001360 con 0x7f64e4095c70 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 >> 172.21.15.129:6789/0 conn(0x7f64e40a3430 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e407ab90 con 0 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40b27b0 con 0 2020-01-26T15:21:52.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f64d4000bf0 con 0x7f64e4095c70 2020-01-26T15:21:52.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e40a6cb0 con 0 2020-01-26T15:21:52.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f64d4001790 con 0x7f64e4095c70 2020-01-26T15:21:52.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f64d40019d0 con 0x7f64e4095c70 2020-01-26T15:21:52.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.374 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f64d4003a60 con 0x7f64e4095c70 2020-01-26T15:21:52.382 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.382 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e407af30 con 0 2020-01-26T15:21:52.388 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.386 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f64e407af30 con 0x7f64e4095c70 2020-01-26T15:21:52.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.478 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64e4073330 con 0 2020-01-26T15:21:52.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.478 7f64d2ffd700 1 -- 172.21.15.129:0/4047855245 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 2414052494) 0x7f64d4002ea0 con 0x7f64e4095c70 2020-01-26T15:21:52.482 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:52.482 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:52.217088","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:52.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 >> 172.21.15.129:6800/11038 conn(0x7f64c4006e70 :-1 s=STATE_OPEN pgs=64 cs=1 l=1).mark_down 2020-01-26T15:21:52.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 >> 172.21.15.129:6790/0 conn(0x7f64e4095c70 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:21:52.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 shutdown_connections 2020-01-26T15:21:52.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 shutdown_connections 2020-01-26T15:21:52.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 wait complete. 2020-01-26T15:21:52.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.482 7f64ebb57700 1 -- 172.21.15.129:0/4047855245 >> 172.21.15.129:0/4047855245 conn(0x7f64e4099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:42.851862', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:43.236142', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:52.494 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:52.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.590 7f274247b700 1 Processor -- start 2020-01-26T15:21:52.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.590 7f274247b700 1 -- - start start 2020-01-26T15:21:52.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.590 7f274247b700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c14bb50 con 0 2020-01-26T15:21:52.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.590 7f274247b700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c14bef0 con 0 2020-01-26T15:21:52.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.590 7f273bfff700 1 -- 172.21.15.129:0/1778360572 learned_addr learned my addr 172.21.15.129:0/1778360572 2020-01-26T15:21:52.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f272c003630 con 0x7f273c148110 2020-01-26T15:21:52.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2724002220 con 0x7f273c14b410 2020-01-26T15:21:52.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4060190347 0 0) 0x7f272c0039b0 con 0x7f273c148110 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f271c002ea0 con 0 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (470153950 0 0) 0x7f27240025a0 con 0x7f273c14b410 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f271c0046b0 con 0 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (310078133 0 0) 0x7f272c003ea0 con 0x7f273c148110 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 >> 172.21.15.129:6791/0 conn(0x7f273c14b410 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c07a8b0 con 0 2020-01-26T15:21:52.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f273c0ea030 con 0x7f273c148110 2020-01-26T15:21:52.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f273b7fe700 1 -- 172.21.15.129:0/1778360572 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f272c001010 con 0x7f273c148110 2020-01-26T15:21:52.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f274247b700 1 -- 172.21.15.129:0/1778360572 >> 172.21.15.129:6789/0 conn(0x7f273c148110 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:21:52.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f274247b700 1 -- 172.21.15.129:0/1778360572 shutdown_connections 2020-01-26T15:21:52.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f274247b700 1 -- 172.21.15.129:0/1778360572 shutdown_connections 2020-01-26T15:21:52.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f274247b700 1 -- 172.21.15.129:0/1778360572 wait complete. 2020-01-26T15:21:52.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.594 7f274247b700 1 -- 172.21.15.129:0/1778360572 >> 172.21.15.129:0/1778360572 conn(0x7f273c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 Processor -- start 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 -- - start start 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0a3d30 con 0 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c095d60 con 0 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f273bfff700 1 -- 172.21.15.129:0/921163902 learned_addr learned my addr 172.21.15.129:0/921163902 2020-01-26T15:21:52.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f272c000e50 con 0x7f273c0a3340 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4268129273 0 0) 0x7f272c0033e0 con 0x7f273c0a3340 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2720002960 con 0 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2724002060 con 0x7f273c0a50f0 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (961256696 0 0) 0x7f2724002870 con 0x7f273c0a50f0 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2720004620 con 0 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3688810734 0 0) 0x7f272c003880 con 0x7f273c0a3340 2020-01-26T15:21:52.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2720002ee0 con 0 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (109929879 0 0) 0x7f2724002ae0 con 0x7f273c0a50f0 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2720003540 con 0 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3311476118 0 0) 0x7f272c0017d0 con 0x7f273c0a3340 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 >> 172.21.15.129:6790/0 conn(0x7f273c0a50f0 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f2739ffb700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c07ab10 con 0 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0b28d0 con 0 2020-01-26T15:21:52.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.598 7f274247b700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0a6b30 con 0 2020-01-26T15:21:52.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.602 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f272c000bf0 con 0x7f273c0a3340 2020-01-26T15:21:52.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.602 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f272c001c00 con 0x7f273c0a3340 2020-01-26T15:21:52.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.602 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f272c004780 con 0x7f273c0a3340 2020-01-26T15:21:52.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.602 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f272c006060 con 0x7f273c0a3340 2020-01-26T15:21:52.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.606 7f274247b700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714002070 con 0 2020-01-26T15:21:52.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.610 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f272c004260 con 0x7f273c0a3340 2020-01-26T15:21:52.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f27140012a0 con 0 2020-01-26T15:21:52.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f2739ffb700 1 -- 172.21.15.129:0/921163902 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7f272c006300 con 0x7f273c0a3340 2020-01-26T15:21:52.704 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:52.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 >> 172.21.15.129:6800/11038 conn(0x7f2720006ed0 :-1 s=STATE_OPEN pgs=65 cs=1 l=1).mark_down 2020-01-26T15:21:52.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 >> 172.21.15.129:6789/0 conn(0x7f273c0a3340 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:21:52.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 shutdown_connections 2020-01-26T15:21:52.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 shutdown_connections 2020-01-26T15:21:52.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 wait complete. 2020-01-26T15:21:52.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.702 7f274247b700 1 -- 172.21.15.129:0/921163902 >> 172.21.15.129:0/921163902 conn(0x7f273c099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.715 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:21:52.822 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.818 7f31da9cd700 1 Processor -- start 2020-01-26T15:21:52.822 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.818 7f31da9cd700 1 -- - start start 2020-01-26T15:21:52.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d414bb50 con 0 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d414bef0 con 0 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d89f3700 1 -- 172.21.15.129:0/1424498221 learned_addr learned my addr 172.21.15.129:0/1424498221 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31c80022a0 con 0x7f31d414b410 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31cc0039b0 con 0x7f31d4148110 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (364139984 0 0) 0x7f31c8002620 con 0x7f31d414b410 2020-01-26T15:21:52.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31c0002ea0 con 0 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (25266142 0 0) 0x7f31cc003d30 con 0x7f31d4148110 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31c00046b0 con 0 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3211630116 0 0) 0x7f31cc0041d0 con 0x7f31d4148110 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 >> 172.21.15.129:6791/0 conn(0x7f31d414b410 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d407a8b0 con 0 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f31d40ea030 con 0x7f31d4148110 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31d37fe700 1 -- 172.21.15.129:0/1424498221 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31cc001390 con 0x7f31d4148110 2020-01-26T15:21:52.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- 172.21.15.129:0/1424498221 >> 172.21.15.129:6789/0 conn(0x7f31d4148110 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:21:52.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- 172.21.15.129:0/1424498221 shutdown_connections 2020-01-26T15:21:52.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- 172.21.15.129:0/1424498221 shutdown_connections 2020-01-26T15:21:52.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- 172.21.15.129:0/1424498221 wait complete. 2020-01-26T15:21:52.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.822 7f31da9cd700 1 -- 172.21.15.129:0/1424498221 >> 172.21.15.129:0/1424498221 conn(0x7f31d4144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 Processor -- start 2020-01-26T15:21:52.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 -- - start start 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40a3ca0 con 0 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40a5150 con 0 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d3fff700 1 -- 172.21.15.129:0/4103576726 learned_addr learned my addr 172.21.15.129:0/4103576726 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31c80020e0 con 0x7f31d4095be0 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2826740711 0 0) 0x7f31c80023a0 con 0x7f31d4095be0 2020-01-26T15:21:52.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31b4002960 con 0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31cc0011d0 con 0x7f31d40a33a0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (527458290 0 0) 0x7f31cc0037c0 con 0x7f31d40a33a0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f31b4004620 con 0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (530324210 0 0) 0x7f31c8000f70 con 0x7f31d4095be0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31b4002ee0 con 0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1193954871 0 0) 0x7f31cc003b40 con 0x7f31d40a33a0 2020-01-26T15:21:52.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31b4003540 con 0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2032622547 0 0) 0x7f31cc001b50 con 0x7f31d40a33a0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 >> 172.21.15.129:6791/0 conn(0x7f31d4095be0 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d407ab10 con 0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40b26e0 con 0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40a69c0 con 0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f31cc000f70 con 0x7f31d40a33a0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f31cc001dc0 con 0x7f31d40a33a0 2020-01-26T15:21:52.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f31cc0048b0 con 0x7f31d40a33a0 2020-01-26T15:21:52.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.826 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f31cc0060f0 con 0x7f31d40a33a0 2020-01-26T15:21:52.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.834 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b0002070 con 0 2020-01-26T15:21:52.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.838 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f31cc004390 con 0x7f31d40a33a0 2020-01-26T15:21:52.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f31b00012a0 con 0 2020-01-26T15:21:52.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31d1ffb700 1 -- 172.21.15.129:0/4103576726 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7f31cc006390 con 0x7f31d40a33a0 2020-01-26T15:21:52.932 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:52.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 >> 172.21.15.129:6800/11038 conn(0x7f31b4006e70 :-1 s=STATE_OPEN pgs=66 cs=1 l=1).mark_down 2020-01-26T15:21:52.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 >> 172.21.15.129:6789/0 conn(0x7f31d40a33a0 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:21:52.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 shutdown_connections 2020-01-26T15:21:52.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 shutdown_connections 2020-01-26T15:21:52.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 wait complete. 2020-01-26T15:21:52.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:52.930 7f31da9cd700 1 -- 172.21.15.129:0/4103576726 >> 172.21.15.129:0/4103576726 conn(0x7f31d40994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:52.946 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:21:53.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da933a700 1 Processor -- start 2020-01-26T15:21:53.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da933a700 1 -- - start start 2020-01-26T15:21:53.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da933a700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da414bba0 con 0 2020-01-26T15:21:53.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da933a700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da414bf40 con 0 2020-01-26T15:21:53.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2a68700 1 -- 172.21.15.129:0/1248884258 learned_addr learned my addr 172.21.15.129:0/1248884258 2020-01-26T15:21:53.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d9c002620 con 0x7f4da4148110 2020-01-26T15:21:53.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2611061072 0 0) 0x7f4d9c0029a0 con 0x7f4da4148110 2020-01-26T15:21:53.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d84002a20 con 0 2020-01-26T15:21:53.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d8c003630 con 0x7f4da414b410 2020-01-26T15:21:53.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (969101858 0 0) 0x7f4d8c0039b0 con 0x7f4da414b410 2020-01-26T15:21:53.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d840046c0 con 0 2020-01-26T15:21:53.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3812310438 0 0) 0x7f4d9c002f70 con 0x7f4da4148110 2020-01-26T15:21:53.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 >> 172.21.15.129:6790/0 conn(0x7f4da414b410 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:21:53.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da407a8b0 con 0 2020-01-26T15:21:53.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4d9c000f70 con 0x7f4da4148110 2020-01-26T15:21:53.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da933a700 1 -- 172.21.15.129:0/1248884258 >> 172.21.15.129:6789/0 conn(0x7f4da4148110 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:21:53.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.038 7f4da2267700 1 -- 172.21.15.129:0/1248884258 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d9c0013d0 con 0x7f4da4148110 2020-01-26T15:21:53.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1248884258 shutdown_connections 2020-01-26T15:21:53.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1248884258 shutdown_connections 2020-01-26T15:21:53.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1248884258 wait complete. 2020-01-26T15:21:53.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1248884258 >> 172.21.15.129:0/1248884258 conn(0x7f4da4144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:53.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 Processor -- start 2020-01-26T15:21:53.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- - start start 2020-01-26T15:21:53.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da40a3e90 con 0 2020-01-26T15:21:53.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da4095eb0 con 0 2020-01-26T15:21:53.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da2a68700 1 -- 172.21.15.129:0/1897471538 learned_addr learned my addr 172.21.15.129:0/1897471538 2020-01-26T15:21:53.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d8c003470 con 0x7f4da40a5200 2020-01-26T15:21:53.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2434425726 0 0) 0x7f4d8c003d40 con 0x7f4da40a5200 2020-01-26T15:21:53.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d88002960 con 0 2020-01-26T15:21:53.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d9c002f70 con 0x7f4da40a3450 2020-01-26T15:21:53.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3941269811 0 0) 0x7f4d9c001250 con 0x7f4da40a3450 2020-01-26T15:21:53.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f4d88004620 con 0 2020-01-26T15:21:53.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (30473502 0 0) 0x7f4d8c000e50 con 0x7f4da40a5200 2020-01-26T15:21:53.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4d88002ee0 con 0 2020-01-26T15:21:53.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1933817833 0 0) 0x7f4d8c0013f0 con 0x7f4da40a5200 2020-01-26T15:21:53.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 >> 172.21.15.129:6790/0 conn(0x7f4da40a3450 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:21:53.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da407ab10 con 0 2020-01-26T15:21:53.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da40b27b0 con 0 2020-01-26T15:21:53.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da933a700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da40a6d40 con 0 2020-01-26T15:21:53.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f4da4116ec0 con 0x7f4da40a5200 2020-01-26T15:21:53.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f4d8c001a30 con 0x7f4da40a5200 2020-01-26T15:21:53.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f4d8c004780 con 0x7f4da40a5200 2020-01-26T15:21:53.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.042 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f4d8c006150 con 0x7f4da40a5200 2020-01-26T15:21:53.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.054 7f4da933a700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da407ae90 con 0 2020-01-26T15:21:53.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.058 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f4da407ae90 con 0x7f4da40a5200 2020-01-26T15:21:53.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f4da4070bc0 con 0 2020-01-26T15:21:53.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da0a64700 1 -- 172.21.15.129:0/1897471538 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f4d8c004430 con 0x7f4da40a5200 2020-01-26T15:21:53.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 >> 172.21.15.129:6800/11038 conn(0x7f4d880065f0 :-1 s=STATE_OPEN pgs=67 cs=1 l=1).mark_down 2020-01-26T15:21:53.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 >> 172.21.15.129:6791/0 conn(0x7f4da40a5200 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:21:53.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 shutdown_connections 2020-01-26T15:21:53.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 shutdown_connections 2020-01-26T15:21:53.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 wait complete. 2020-01-26T15:21:53.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.150 7f4da933a700 1 -- 172.21.15.129:0/1897471538 >> 172.21.15.129:0/1897471538 conn(0x7f4da4099560 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:53.155 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:53.167 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-01-26T15:21:53.168 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:21:53.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.258 7f2ead6d2700 1 Processor -- start 2020-01-26T15:21:53.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- - start start 2020-01-26T15:21:53.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea814bb10 con 0 2020-01-26T15:21:53.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea814beb0 con 0 2020-01-26T15:21:53.263 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea7572700 1 -- 172.21.15.129:0/188030855 learned_addr learned my addr 172.21.15.129:0/188030855 2020-01-26T15:21:53.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e98003630 con 0x7f2ea81480d0 2020-01-26T15:21:53.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1649364550 0 0) 0x7f2e980039b0 con 0x7f2ea81480d0 2020-01-26T15:21:53.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e88002a20 con 0 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e900022a0 con 0x7f2ea814b3d0 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1094433231 0 0) 0x7f2e90002620 con 0x7f2ea814b3d0 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e880046c0 con 0 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3133109365 0 0) 0x7f2e90002ac0 con 0x7f2ea814b3d0 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 >> 172.21.15.129:6790/0 conn(0x7f2ea81480d0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-01-26T15:21:53.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea807a930 con 0 2020-01-26T15:21:53.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2ea8116e80 con 0x7f2ea814b3d0 2020-01-26T15:21:53.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ea6d71700 1 -- 172.21.15.129:0/188030855 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e90001010 con 0x7f2ea814b3d0 2020-01-26T15:21:53.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- 172.21.15.129:0/188030855 >> 172.21.15.129:6791/0 conn(0x7f2ea814b3d0 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:21:53.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- 172.21.15.129:0/188030855 shutdown_connections 2020-01-26T15:21:53.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- 172.21.15.129:0/188030855 shutdown_connections 2020-01-26T15:21:53.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- 172.21.15.129:0/188030855 wait complete. 2020-01-26T15:21:53.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.262 7f2ead6d2700 1 -- 172.21.15.129:0/188030855 >> 172.21.15.129:0/188030855 conn(0x7f2ea8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:53.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ead6d2700 1 Processor -- start 2020-01-26T15:21:53.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ead6d2700 1 -- - start start 2020-01-26T15:21:53.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ead6d2700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80a3d00 con 0 2020-01-26T15:21:53.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ead6d2700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80a6ad0 con 0 2020-01-26T15:21:53.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ea7572700 1 -- 172.21.15.129:0/2617416118 learned_addr learned my addr 172.21.15.129:0/2617416118 2020-01-26T15:21:53.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e98003440 con 0x7f2ea80a3310 2020-01-26T15:21:53.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (373013578 0 0) 0x7f2e98003780 con 0x7f2ea80a3310 2020-01-26T15:21:53.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.266 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e8c002960 con 0 2020-01-26T15:21:53.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e90000e50 con 0x7f2ea80a6320 2020-01-26T15:21:53.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1608506228 0 0) 0x7f2e90002080 con 0x7f2ea80a6320 2020-01-26T15:21:53.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f2e8c004620 con 0 2020-01-26T15:21:53.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2178738887 0 0) 0x7f2e98003ab0 con 0x7f2ea80a3310 2020-01-26T15:21:53.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e8c004fa0 con 0 2020-01-26T15:21:53.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (352133709 0 0) 0x7f2e90002400 con 0x7f2ea80a6320 2020-01-26T15:21:53.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e8c0076a0 con 0 2020-01-26T15:21:53.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1654597062 0 0) 0x7f2e900017d0 con 0x7f2ea80a6320 2020-01-26T15:21:53.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 >> 172.21.15.129:6791/0 conn(0x7f2ea80a3310 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:21:53.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea807ab90 con 0 2020-01-26T15:21:53.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea80712f0 con 0 2020-01-26T15:21:53.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea818b180 con 0 2020-01-26T15:21:53.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f2e90000bf0 con 0x7f2ea80a6320 2020-01-26T15:21:53.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f2e90001a40 con 0x7f2ea80a6320 2020-01-26T15:21:53.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f2e900032f0 con 0x7f2ea80a6320 2020-01-26T15:21:53.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.270 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f2e90004a40 con 0x7f2ea80a6320 2020-01-26T15:21:53.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.274 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e80002070 con 0 2020-01-26T15:21:53.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.274 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f2e90002dd0 con 0x7f2ea80a6320 2020-01-26T15:21:53.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.358 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e800011a0 con 0 2020-01-26T15:21:53.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ea556e700 1 -- 172.21.15.129:0/2617416118 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2250 (3717936808 0 1722169651) 0x7f2e90003ab0 con 0x7f2ea80a6320 2020-01-26T15:21:53.363 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 5 2020-01-26T15:21:53.363 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:53.363 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:21:46.806578","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:21:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 >> 172.21.15.129:6800/11038 conn(0x7f2e8c005ff0 :-1 s=STATE_OPEN pgs=68 cs=1 l=1).mark_down 2020-01-26T15:21:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 >> 172.21.15.129:6790/0 conn(0x7f2ea80a6320 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:21:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 shutdown_connections 2020-01-26T15:21:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 shutdown_connections 2020-01-26T15:21:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 wait complete. 2020-01-26T15:21:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:53.362 7f2ead6d2700 1 -- 172.21.15.129:0/2617416118 >> 172.21.15.129:0/2617416118 conn(0x7f2ea8099710 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:53.676 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4209}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4209': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 4, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4209, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.129:6819/2338999715'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:21:44.187366', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:21:46.806578', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:21:53.676 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:21:53.677 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:21:53.764 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:21:53.764 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:21:53.764 INFO:teuthology.orchestra.run.smithi129.stdout: "whoami": 0, 2020-01-26T15:21:53.765 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4209, 2020-01-26T15:21:53.765 INFO:teuthology.orchestra.run.smithi129.stdout: "want_state": "up:active", 2020-01-26T15:21:53.765 INFO:teuthology.orchestra.run.smithi129.stdout: "state": "up:active", 2020-01-26T15:21:53.765 INFO:teuthology.orchestra.run.smithi129.stdout: "rank_uptime": 7.958315, 2020-01-26T15:21:53.765 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 5, 2020-01-26T15:21:53.766 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch": 16, 2020-01-26T15:21:53.766 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch_barrier": 15, 2020-01-26T15:21:53.766 INFO:teuthology.orchestra.run.smithi129.stdout: "uptime": 7.999729 2020-01-26T15:21:53.766 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:21:53.771 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", "whoami": 0, "id": 4209, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.958315, "mdsmap_epoch": 5, "osdmap_epoch": 16, "osdmap_epoch_barrier": 15, "uptime": 7.999729 } 2020-01-26T15:21:53.771 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-01-26T15:21:53.771 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-01-26T15:21:53.771 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi042.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-01-26T15:21:53.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:53.772 INFO:teuthology.orchestra.run.smithi042:> mkdir -p /home/ubuntu/cephtest/mnt.1 2020-01-26T15:21:53.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:53.783 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:53.843 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:53.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:53.843 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-01-26T15:21:53.894 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-01-26T15:21:53.894 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1 2020-01-26T15:21:53.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:53.930 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:53.946 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:53.950 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:53.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:53.951 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-01-26T15:21:54.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi042.stderr:2020-01-26 15:21:54.022 7f61f5237b80 -1 init, newargv = 0x55f7ce48e7c0 newargc=7ceph-fuse[ 2020-01-26T15:21:54.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi042.stderr:10145]: starting ceph client 2020-01-26T15:21:54.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi042.stderr:ceph-fuse[10145]: starting fuse 2020-01-26T15:21:55.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:55.099 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:55.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:55.118 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:55.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:55.119 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-01-26T15:21:55.173 INFO:teuthology.orchestra.run.smithi042.stdout:49 2020-01-26T15:21:55.173 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-01-26T15:21:55.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:55.173 INFO:teuthology.orchestra.run.smithi042:> sudo python3 -c ' 2020-01-26T15:21:55.173 INFO:teuthology.orchestra.run.smithi042:> import glob 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> import re 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> import os 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> import subprocess 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> def find_socket(client_name): 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2020-01-26T15:21:55.174 INFO:teuthology.orchestra.run.smithi042:> 2020-01-26T15:21:55.175 INFO:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2020-01-26T15:21:55.175 INFO:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2020-01-26T15:21:55.175 INFO:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2020-01-26T15:21:55.175 INFO:teuthology.orchestra.run.smithi042:> return files[0] 2020-01-26T15:21:55.175 INFO:teuthology.orchestra.run.smithi042:> 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> for f in files: 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> return f 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> print(find_socket("client.1")) 2020-01-26T15:21:55.176 INFO:teuthology.orchestra.run.smithi042:> ' 2020-01-26T15:21:55.280 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.1.10145.asok 2020-01-26T15:21:55.280 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.10145.asok 2020-01-26T15:21:55.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:55.280 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.10145.asok status 2020-01-26T15:21:55.401 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-01-26T15:21:55.402 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "e1c5fd9306ce839d8d3ac8160c57aba42e0231a8", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 13.2.8-63-ge1c5fd9 (e1c5fd9306ce839d8d3ac8160c57aba42e0231a8) mimic (stable)", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "1", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "10145", 2020-01-26T15:21:55.403 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2020-01-26T15:21:55.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4329, 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2020-01-26T15:21:55.405 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 4329 2020-01-26T15:21:55.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-01-26T15:21:55.407 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2020-01-26T15:21:55.407 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3678542210, 2020-01-26T15:21:55.407 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0" 2020-01-26T15:21:55.407 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-01-26T15:21:55.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-01-26T15:21:55.408 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.4329 172.21.15.42:0/3678542210", 2020-01-26T15:21:55.408 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "172.21.15.42:0/3678542210", 2020-01-26T15:21:55.409 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2020-01-26T15:21:55.409 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 5, 2020-01-26T15:21:55.409 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 16, 2020-01-26T15:21:55.409 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2020-01-26T15:21:55.409 INFO:teuthology.orchestra.run.smithi042.stdout: "blacklisted": false 2020-01-26T15:21:55.410 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-01-26T15:21:55.410 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:55.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 Processor -- start 2020-01-26T15:21:55.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- - start start 2020-01-26T15:21:55.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114414bb10 con 0 2020-01-26T15:21:55.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114414beb0 con 0 2020-01-26T15:21:55.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f11494e8700 1 -- 172.21.15.129:0/58140135 learned_addr learned my addr 172.21.15.129:0/58140135 2020-01-26T15:21:55.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f11400022a0 con 0x7f11441480d0 2020-01-26T15:21:55.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1138003630 con 0x7f114414b3d0 2020-01-26T15:21:55.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3514588369 0 0) 0x7f1138003930 con 0x7f114414b3d0 2020-01-26T15:21:55.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1128002f40 con 0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (624932055 0 0) 0x7f1140002620 con 0x7f11441480d0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1128004740 con 0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1128694935 0 0) 0x7f1138003dd0 con 0x7f114414b3d0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 >> 172.21.15.129:6790/0 conn(0x7f11441480d0 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114407a930 con 0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1144116e80 con 0x7f114414b3d0 2020-01-26T15:21:55.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f1148ce7700 1 -- 172.21.15.129:0/58140135 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1138001010 con 0x7f114414b3d0 2020-01-26T15:21:55.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- 172.21.15.129:0/58140135 >> 172.21.15.129:6791/0 conn(0x7f114414b3d0 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:21:55.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- 172.21.15.129:0/58140135 shutdown_connections 2020-01-26T15:21:55.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- 172.21.15.129:0/58140135 shutdown_connections 2020-01-26T15:21:55.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- 172.21.15.129:0/58140135 wait complete. 2020-01-26T15:21:55.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.514 7f114bcc3700 1 -- 172.21.15.129:0/58140135 >> 172.21.15.129:0/58140135 conn(0x7f1144144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:55.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 Processor -- start 2020-01-26T15:21:55.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 -- - start start 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440a3d00 con 0 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440a6ad0 con 0 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1149ce9700 1 -- 172.21.15.129:0/1323426618 learned_addr learned my addr 172.21.15.129:0/1323426618 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f11400020e0 con 0x7f11440a3310 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1541795948 0 0) 0x7f11400023a0 con 0x7f11440a3310 2020-01-26T15:21:55.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f112c0029c0 con 0 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1138003f90 con 0x7f11440a6320 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3419022431 0 0) 0x7f1138000ed0 con 0x7f11440a6320 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f112c004680 con 0 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (426629224 0 0) 0x7f1140000e50 con 0x7f11440a3310 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f112c002f40 con 0 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (212422795 0 0) 0x7f1138003530 con 0x7f11440a6320 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f112c0035a0 con 0 2020-01-26T15:21:55.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2482533921 0 0) 0x7f11400014e0 con 0x7f11440a3310 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 >> 172.21.15.129:6789/0 conn(0x7f11440a6320 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114407ab90 con 0 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11440712f0 con 0 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f114418b180 con 0 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1140000bf0 con 0x7f11440a3310 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1140001910 con 0x7f11440a3310 2020-01-26T15:21:55.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f11400044b0 con 0x7f11440a3310 2020-01-26T15:21:55.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.518 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f1140004790 con 0x7f11440a3310 2020-01-26T15:21:55.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.526 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120002070 con 0 2020-01-26T15:21:55.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.534 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1140004c70 con 0x7f11440a3310 2020-01-26T15:21:55.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1120001220 con 0 2020-01-26T15:21:55.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f1136ffd700 1 -- 172.21.15.129:0/1323426618 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 2414052494) 0x7f1140003f90 con 0x7f11440a3310 2020-01-26T15:21:55.628 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:55.628 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:52.217088","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 >> 172.21.15.129:6800/11038 conn(0x7f112c006ec0 :-1 s=STATE_OPEN pgs=69 cs=1 l=1).mark_down 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 >> 172.21.15.129:6791/0 conn(0x7f11440a3310 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 shutdown_connections 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 shutdown_connections 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 wait complete. 2020-01-26T15:21:55.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.626 7f114bcc3700 1 -- 172.21.15.129:0/1323426618 >> 172.21.15.129:0/1323426618 conn(0x7f11440994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:55.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:42.851862', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:43.236142', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:55.641 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:55.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.734 7fbf6cd69700 1 Processor -- start 2020-01-26T15:21:55.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.734 7fbf6cd69700 1 -- - start start 2020-01-26T15:21:55.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6814bb40 con 0 2020-01-26T15:21:55.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6814bee0 con 0 2020-01-26T15:21:55.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66d71700 1 -- 172.21.15.129:0/4055131278 learned_addr learned my addr 172.21.15.129:0/4055131278 2020-01-26T15:21:55.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf500022a0 con 0x7fbf6814b400 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3023612278 0 0) 0x7fbf50002620 con 0x7fbf6814b400 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbf48002a20 con 0 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf58003630 con 0x7fbf68148100 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4163066307 0 0) 0x7fbf58003930 con 0x7fbf68148100 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbf480046c0 con 0 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4011122351 0 0) 0x7fbf50002bf0 con 0x7fbf6814b400 2020-01-26T15:21:55.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 >> 172.21.15.129:6791/0 conn(0x7fbf68148100 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:21:55.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6807a8a0 con 0 2020-01-26T15:21:55.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbf68116eb0 con 0x7fbf6814b400 2020-01-26T15:21:55.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf66570700 1 -- 172.21.15.129:0/4055131278 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf50001050 con 0x7fbf6814b400 2020-01-26T15:21:55.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- 172.21.15.129:0/4055131278 >> 172.21.15.129:6789/0 conn(0x7fbf6814b400 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:21:55.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- 172.21.15.129:0/4055131278 shutdown_connections 2020-01-26T15:21:55.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- 172.21.15.129:0/4055131278 shutdown_connections 2020-01-26T15:21:55.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- 172.21.15.129:0/4055131278 wait complete. 2020-01-26T15:21:55.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.738 7fbf6cd69700 1 -- 172.21.15.129:0/4055131278 >> 172.21.15.129:0/4055131278 conn(0x7fbf68144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:55.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 Processor -- start 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 -- - start start 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680a3c80 con 0 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680a5130 con 0 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf66d71700 1 -- 172.21.15.129:0/1169709257 learned_addr learned my addr 172.21.15.129:0/1169709257 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf58003f60 con 0x7fbf680a3380 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1180214860 0 0) 0x7fbf58003470 con 0x7fbf680a3380 2020-01-26T15:21:55.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbf4c002960 con 0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf50000e50 con 0x7fbf68095bc0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2171952761 0 0) 0x7fbf50001ff0 con 0x7fbf68095bc0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbf4c004620 con 0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1932104960 0 0) 0x7fbf58003980 con 0x7fbf680a3380 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf4c002ee0 con 0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1822650203 0 0) 0x7fbf50002370 con 0x7fbf68095bc0 2020-01-26T15:21:55.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf4c003540 con 0 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3300199745 0 0) 0x7fbf580010f0 con 0x7fbf680a3380 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 >> 172.21.15.129:6790/0 conn(0x7fbf68095bc0 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6807ab00 con 0 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf680b28f0 con 0 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf680a6bc0 con 0 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbf680ea020 con 0x7fbf680a3380 2020-01-26T15:21:55.749 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbf58001520 con 0x7fbf680a3380 2020-01-26T15:21:55.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fbf58004260 con 0x7fbf680a3380 2020-01-26T15:21:55.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.742 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fbf58005f70 con 0x7fbf680a3380 2020-01-26T15:21:55.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.750 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40002070 con 0 2020-01-26T15:21:55.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.754 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fbf5801a040 con 0x7fbf680a3380 2020-01-26T15:21:55.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.846 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fbf400012a0 con 0 2020-01-26T15:21:55.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.846 7fbf64d6d700 1 -- 172.21.15.129:0/1169709257 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7fbf58007020 con 0x7fbf680a3380 2020-01-26T15:21:55.849 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:55.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 >> 172.21.15.129:6800/11038 conn(0x7fbf4c006ed0 :-1 s=STATE_OPEN pgs=70 cs=1 l=1).mark_down 2020-01-26T15:21:55.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 >> 172.21.15.129:6791/0 conn(0x7fbf680a3380 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:21:55.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 shutdown_connections 2020-01-26T15:21:55.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 shutdown_connections 2020-01-26T15:21:55.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 wait complete. 2020-01-26T15:21:55.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.850 7fbf6cd69700 1 -- 172.21.15.129:0/1169709257 >> 172.21.15.129:0/1169709257 conn(0x7fbf680994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:55.861 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:21:55.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 Processor -- start 2020-01-26T15:21:55.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- - start start 2020-01-26T15:21:55.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3414bb50 con 0 2020-01-26T15:21:55.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3414bef0 con 0 2020-01-26T15:21:55.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d337fe700 1 -- 172.21.15.129:0/876648717 learned_addr learned my addr 172.21.15.129:0/876648717 2020-01-26T15:21:55.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d280022a0 con 0x7f1d3414b410 2020-01-26T15:21:55.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2898043905 0 0) 0x7f1d28002620 con 0x7f1d3414b410 2020-01-26T15:21:55.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1d20002a20 con 0 2020-01-26T15:21:55.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d240039b0 con 0x7f1d34148110 2020-01-26T15:21:55.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (681732176 0 0) 0x7f1d24003cb0 con 0x7f1d34148110 2020-01-26T15:21:55.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1d200046b0 con 0 2020-01-26T15:21:55.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4057760473 0 0) 0x7f1d28002bf0 con 0x7f1d3414b410 2020-01-26T15:21:55.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 >> 172.21.15.129:6789/0 conn(0x7f1d34148110 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:21:55.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3407a8b0 con 0 2020-01-26T15:21:55.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1d34116ec0 con 0x7f1d3414b410 2020-01-26T15:21:55.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d327fc700 1 -- 172.21.15.129:0/876648717 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d28001050 con 0x7f1d3414b410 2020-01-26T15:21:55.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- 172.21.15.129:0/876648717 >> 172.21.15.129:6790/0 conn(0x7f1d3414b410 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:21:55.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- 172.21.15.129:0/876648717 shutdown_connections 2020-01-26T15:21:55.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- 172.21.15.129:0/876648717 shutdown_connections 2020-01-26T15:21:55.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- 172.21.15.129:0/876648717 wait complete. 2020-01-26T15:21:55.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.958 7f1d3992e700 1 -- 172.21.15.129:0/876648717 >> 172.21.15.129:0/876648717 conn(0x7f1d34144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:55.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d3992e700 1 Processor -- start 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d3992e700 1 -- - start start 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d3992e700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340a3e10 con 0 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d3992e700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340a5330 con 0 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d337fe700 1 -- 172.21.15.129:0/3756887059 learned_addr learned my addr 172.21.15.129:0/3756887059 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d240042e0 con 0x7f1d340a3420 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d28000e50 con 0x7f1d34095c60 2020-01-26T15:21:55.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4123194200 0 0) 0x7f1d240037f0 con 0x7f1d340a3420 2020-01-26T15:21:55.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1d14002df0 con 0 2020-01-26T15:21:55.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3774184498 0 0) 0x7f1d28001ff0 con 0x7f1d34095c60 2020-01-26T15:21:55.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.962 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1d14004620 con 0 2020-01-26T15:21:55.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3789992173 0 0) 0x7f1d24003cf0 con 0x7f1d340a3420 2020-01-26T15:21:55.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d14004df0 con 0 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4198348188 0 0) 0x7f1d28002370 con 0x7f1d34095c60 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d14006570 con 0 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (859601745 0 0) 0x7f1d24001470 con 0x7f1d340a3420 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 >> 172.21.15.129:6790/0 conn(0x7f1d34095c60 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3407ab10 con 0 2020-01-26T15:21:55.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d340711a0 con 0 2020-01-26T15:21:55.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d340a6c60 con 0 2020-01-26T15:21:55.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1d24000f70 con 0x7f1d340a3420 2020-01-26T15:21:55.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1d240018a0 con 0x7f1d340a3420 2020-01-26T15:21:55.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f1d240045e0 con 0x7f1d340a3420 2020-01-26T15:21:55.998 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.966 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f1d24001ae0 con 0x7f1d340a3420 2020-01-26T15:21:55.999 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.970 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d10002070 con 0 2020-01-26T15:21:55.999 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:55.974 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1d24001f70 con 0x7f1d340a3420 2020-01-26T15:21:56.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.066 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f1d100012a0 con 0 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d30ff9700 1 -- 172.21.15.129:0/3756887059 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7f1d240059b0 con 0x7f1d340a3420 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 >> 172.21.15.129:6800/11038 conn(0x7f1d140072a0 :-1 s=STATE_OPEN pgs=71 cs=1 l=1).mark_down 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 >> 172.21.15.129:6789/0 conn(0x7f1d340a3420 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 shutdown_connections 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 shutdown_connections 2020-01-26T15:21:56.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 wait complete. 2020-01-26T15:21:56.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.070 7f1d3992e700 1 -- 172.21.15.129:0/3756887059 >> 172.21.15.129:0/3756887059 conn(0x7f1d340995d0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:56.080 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:56.086 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:21:56.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 Processor -- start 2020-01-26T15:21:56.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- - start start 2020-01-26T15:21:56.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653014bb50 con 0 2020-01-26T15:21:56.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653014bef0 con 0 2020-01-26T15:21:56.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652f7fe700 1 -- 172.21.15.129:0/3755027909 learned_addr learned my addr 172.21.15.129:0/3755027909 2020-01-26T15:21:56.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f65280039b0 con 0x7f6530148110 2020-01-26T15:21:56.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4055059469 0 0) 0x7f6528003d30 con 0x7f6530148110 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6510002a20 con 0 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f65200022a0 con 0x7f653014b410 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2566722707 0 0) 0x7f65200025a0 con 0x7f653014b410 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f65100046c0 con 0 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3762208798 0 0) 0x7f6528004230 con 0x7f6530148110 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 >> 172.21.15.129:6791/0 conn(0x7f653014b410 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:21:56.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653007a8b0 con 0 2020-01-26T15:21:56.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f65300ea030 con 0x7f6530148110 2020-01-26T15:21:56.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f652e7fc700 1 -- 172.21.15.129:0/3755027909 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6528001390 con 0x7f6530148110 2020-01-26T15:21:56.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- 172.21.15.129:0/3755027909 >> 172.21.15.129:6790/0 conn(0x7f6530148110 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:21:56.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- 172.21.15.129:0/3755027909 shutdown_connections 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- 172.21.15.129:0/3755027909 shutdown_connections 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- 172.21.15.129:0/3755027909 wait complete. 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.190 7f6535eb7700 1 -- 172.21.15.129:0/3755027909 >> 172.21.15.129:0/3755027909 conn(0x7f6530144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f6535eb7700 1 Processor -- start 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f6535eb7700 1 -- - start start 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f6535eb7700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65300a3d40 con 0 2020-01-26T15:21:56.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f6535eb7700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6530095d70 con 0 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652f7fe700 1 -- 172.21.15.129:0/3767016394 learned_addr learned my addr 172.21.15.129:0/3767016394 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f65280011d0 con 0x7f65300a3350 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (814249616 0 0) 0x7f65280018b0 con 0x7f65300a3350 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6514002960 con 0 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6520002ae0 con 0x7f65300a5100 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1353288630 0 0) 0x7f65200020e0 con 0x7f65300a5100 2020-01-26T15:21:56.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6514004620 con 0 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4157046170 0 0) 0x7f6528001e20 con 0x7f65300a3350 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6514002ee0 con 0 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3230094339 0 0) 0x7f6520002350 con 0x7f65300a5100 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6514003540 con 0 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.194 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2708529532 0 0) 0x7f65200010f0 con 0x7f65300a5100 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 >> 172.21.15.129:6790/0 conn(0x7f65300a3350 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653007ab10 con 0 2020-01-26T15:21:56.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65300b2710 con 0 2020-01-26T15:21:56.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f65300a6b80 con 0 2020-01-26T15:21:56.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6520000bf0 con 0x7f65300a5100 2020-01-26T15:21:56.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6520001360 con 0x7f65300a5100 2020-01-26T15:21:56.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f6520001ac0 con 0x7f65300a5100 2020-01-26T15:21:56.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.198 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f65200047a0 con 0x7f65300a5100 2020-01-26T15:21:56.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.202 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508002070 con 0 2020-01-26T15:21:56.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.210 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f65200015a0 con 0x7f65300a5100 2020-01-26T15:21:56.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.302 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f65080012a0 con 0 2020-01-26T15:21:56.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.302 7f652cff9700 1 -- 172.21.15.129:0/3767016394 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7f6520004a40 con 0x7f65300a5100 2020-01-26T15:21:56.305 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.302 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 >> 172.21.15.129:6800/11038 conn(0x7f6514006ed0 :-1 s=STATE_OPEN pgs=72 cs=1 l=1).mark_down 2020-01-26T15:21:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.306 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 >> 172.21.15.129:6789/0 conn(0x7f65300a5100 :-1 s=STATE_OPEN pgs=87 cs=1 l=1).mark_down 2020-01-26T15:21:56.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.306 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 shutdown_connections 2020-01-26T15:21:56.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.306 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 shutdown_connections 2020-01-26T15:21:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.306 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 wait complete. 2020-01-26T15:21:56.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.306 7f6535eb7700 1 -- 172.21.15.129:0/3767016394 >> 172.21.15.129:0/3767016394 conn(0x7f6530099460 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:56.316 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-01-26T15:21:56.317 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:21:56.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06cbd95700 1 Processor -- start 2020-01-26T15:21:56.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06cbd95700 1 -- - start start 2020-01-26T15:21:56.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06cbd95700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c414bb10 con 0 2020-01-26T15:21:56.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06cbd95700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c414beb0 con 0 2020-01-26T15:21:56.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c9dbb700 1 -- 172.21.15.129:0/1255989432 learned_addr learned my addr 172.21.15.129:0/1255989432 2020-01-26T15:21:56.411 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06c0003630 con 0x7f06c41480d0 2020-01-26T15:21:56.411 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2019447371 0 0) 0x7f06c00039b0 con 0x7f06c41480d0 2020-01-26T15:21:56.411 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06ac002a20 con 0 2020-01-26T15:21:56.411 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06b40022a0 con 0x7f06c414b3d0 2020-01-26T15:21:56.411 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2145821621 0 0) 0x7f06b40025a0 con 0x7f06c414b3d0 2020-01-26T15:21:56.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06ac0046c0 con 0 2020-01-26T15:21:56.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1177861964 0 0) 0x7f06c0003f80 con 0x7f06c41480d0 2020-01-26T15:21:56.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 >> 172.21.15.129:6789/0 conn(0x7f06c414b3d0 :-1 s=STATE_OPEN pgs=88 cs=1 l=1).mark_down 2020-01-26T15:21:56.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c407a930 con 0 2020-01-26T15:21:56.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f06c40e9ff0 con 0x7f06c41480d0 2020-01-26T15:21:56.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06c8db9700 1 -- 172.21.15.129:0/1255989432 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06c0001050 con 0x7f06c41480d0 2020-01-26T15:21:56.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.406 7f06cbd95700 1 -- 172.21.15.129:0/1255989432 >> 172.21.15.129:6790/0 conn(0x7f06c41480d0 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:21:56.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1255989432 shutdown_connections 2020-01-26T15:21:56.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1255989432 shutdown_connections 2020-01-26T15:21:56.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1255989432 wait complete. 2020-01-26T15:21:56.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1255989432 >> 172.21.15.129:0/1255989432 conn(0x7f06c4144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:56.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 Processor -- start 2020-01-26T15:21:56.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- - start start 2020-01-26T15:21:56.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40a3de0 con 0 2020-01-26T15:21:56.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40a6bb0 con 0 2020-01-26T15:21:56.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06c95ba700 1 -- 172.21.15.129:0/1849933187 learned_addr learned my addr 172.21.15.129:0/1849933187 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06b40020e0 con 0x7f06c40a6400 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (678195467 0 0) 0x7f06b40023e0 con 0x7f06c40a6400 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06a4002960 con 0 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06c0000e50 con 0x7f06c40a33f0 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2143362779 0 0) 0x7f06c0003380 con 0x7f06c40a33f0 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f06a4004620 con 0 2020-01-26T15:21:56.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2409919505 0 0) 0x7f06b4000e50 con 0x7f06c40a6400 2020-01-26T15:21:56.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06a4002ee0 con 0 2020-01-26T15:21:56.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3490391192 0 0) 0x7f06c0003710 con 0x7f06c40a33f0 2020-01-26T15:21:56.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f06a4003540 con 0 2020-01-26T15:21:56.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3295793341 0 0) 0x7f06b40014b0 con 0x7f06c40a6400 2020-01-26T15:21:56.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 >> 172.21.15.129:6789/0 conn(0x7f06c40a33f0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:21:56.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c407ab90 con 0 2020-01-26T15:21:56.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40b2940 con 0 2020-01-26T15:21:56.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f06b4000bf0 con 0x7f06c40a6400 2020-01-26T15:21:56.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f06b40018e0 con 0x7f06c40a6400 2020-01-26T15:21:56.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.410 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c418b200 con 0 2020-01-26T15:21:56.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.414 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f06b40044b0 con 0x7f06c40a6400 2020-01-26T15:21:56.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.414 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f06b4005e30 con 0x7f06c40a6400 2020-01-26T15:21:56.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.418 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c407af30 con 0 2020-01-26T15:21:56.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.422 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f06c407af30 con 0x7f06c40a6400 2020-01-26T15:21:56.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.514 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c41563d0 con 0 2020-01-26T15:21:56.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.514 7f06b2ffd700 1 -- 172.21.15.129:0/1849933187 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2250 (3717936808 0 1722169651) 0x7f06b4004990 con 0x7f06c40a6400 2020-01-26T15:21:56.517 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:56.517 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:21:46.806578","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:21:56.517 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 5 2020-01-26T15:21:56.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 >> 172.21.15.129:6800/11038 conn(0x7f06a4006ed0 :-1 s=STATE_OPEN pgs=73 cs=1 l=1).mark_down 2020-01-26T15:21:56.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 >> 172.21.15.129:6790/0 conn(0x7f06c40a6400 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:21:56.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 shutdown_connections 2020-01-26T15:21:56.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 shutdown_connections 2020-01-26T15:21:56.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 wait complete. 2020-01-26T15:21:56.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:56.518 7f06cbd95700 1 -- 172.21.15.129:0/1849933187 >> 172.21.15.129:0/1849933187 conn(0x7f06c4099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:56.838 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4209}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 5, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4209': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 4, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4209, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.129:6819/2338999715'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:21:44.187366', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:21:46.806578', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:21:56.838 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:21:56.839 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:21:56.927 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:21:56.927 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:21:56.927 INFO:teuthology.orchestra.run.smithi129.stdout: "whoami": 0, 2020-01-26T15:21:56.927 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4209, 2020-01-26T15:21:56.927 INFO:teuthology.orchestra.run.smithi129.stdout: "want_state": "up:active", 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "state": "up:active", 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "rank_uptime": 11.117497, 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 5, 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch": 16, 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch_barrier": 15, 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout: "uptime": 11.158909 2020-01-26T15:21:56.928 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:21:56.929 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", "whoami": 0, "id": 4209, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.117497, "mdsmap_epoch": 5, "osdmap_epoch": 16, "osdmap_epoch_barrier": 15, "uptime": 11.158909 } 2020-01-26T15:21:56.933 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-01-26T15:21:56.933 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-01-26T15:21:56.933 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi204.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-01-26T15:21:56.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:56.934 INFO:teuthology.orchestra.run.smithi204:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-01-26T15:21:56.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:56.943 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:56.999 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:57.001 INFO:teuthology.orchestra.run.smithi204.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:57.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:57.002 INFO:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2020-01-26T15:21:57.050 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-01-26T15:21:57.050 INFO:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-01-26T15:21:57.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:57.097 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:57.113 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:57.117 INFO:teuthology.orchestra.run.smithi204.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:57.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:57.117 INFO:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2020-01-26T15:21:57.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi204.stderr:2020-01-26 15:21:57.176 7f5ae7843b80 -1 init, newargv = 0x5611031c47c0 newargc=7 2020-01-26T15:21:57.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi204.stderr:ceph-fuse[10034]: starting ceph client 2020-01-26T15:21:57.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi204.stderr:ceph-fuse[10034]: starting fuse 2020-01-26T15:21:58.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.267 INFO:teuthology.orchestra.run.smithi204:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-01-26T15:21:58.284 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-01-26T15:21:58.286 INFO:teuthology.orchestra.run.smithi204.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-01-26T15:21:58.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.287 INFO:teuthology.orchestra.run.smithi204:> ls /sys/fs/fuse/connections 2020-01-26T15:21:58.337 INFO:teuthology.orchestra.run.smithi204.stdout:49 2020-01-26T15:21:58.337 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-01-26T15:21:58.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> sudo python3 -c ' 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> import glob 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> import re 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> import os 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> import subprocess 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> 2020-01-26T15:21:58.338 INFO:teuthology.orchestra.run.smithi204:> def find_socket(client_name): 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> files = glob.glob(asok_path) 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> # Given a non-glob path, it better be there 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> if "*" not in asok_path: 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> assert(len(files) == 1) 2020-01-26T15:21:58.339 INFO:teuthology.orchestra.run.smithi204:> return files[0] 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> for f in files: 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> if os.path.exists("/proc/{0}".format(pid)): 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> return f 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> print(find_socket("client.0")) 2020-01-26T15:21:58.340 INFO:teuthology.orchestra.run.smithi204:> ' 2020-01-26T15:21:58.448 INFO:teuthology.orchestra.run.smithi204.stdout:/var/run/ceph/ceph-client.0.10034.asok 2020-01-26T15:21:58.448 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.10034.asok 2020-01-26T15:21:58.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.448 INFO:teuthology.orchestra.run.smithi204:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.10034.asok status 2020-01-26T15:21:58.566 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2020-01-26T15:21:58.567 INFO:teuthology.orchestra.run.smithi204.stdout: "metadata": { 2020-01-26T15:21:58.567 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_sha1": "e1c5fd9306ce839d8d3ac8160c57aba42e0231a8", 2020-01-26T15:21:58.567 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 13.2.8-63-ge1c5fd9 (e1c5fd9306ce839d8d3ac8160c57aba42e0231a8) mimic (stable)", 2020-01-26T15:21:58.567 INFO:teuthology.orchestra.run.smithi204.stdout: "entity_id": "0", 2020-01-26T15:21:58.567 INFO:teuthology.orchestra.run.smithi204.stdout: "hostname": "smithi204", 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: "pid": "10034", 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: "root": "/" 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_count": 0, 2020-01-26T15:21:58.568 INFO:teuthology.orchestra.run.smithi204.stdout: "dentry_pinned_count": 0, 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "id": 4356, 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "inst": { 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "name": { 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "type": "client", 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "num": 4356 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2020-01-26T15:21:58.569 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": { 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: "nonce": 3756525845, 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: "addr": "172.21.15.204:0" 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: } 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: }, 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: "inst_str": "client.4356 172.21.15.204:0/3756525845", 2020-01-26T15:21:58.570 INFO:teuthology.orchestra.run.smithi204.stdout: "addr_str": "172.21.15.204:0/3756525845", 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout: "inode_count": 1, 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout: "mds_epoch": 5, 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch": 16, 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout: "osd_epoch_barrier": 0, 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout: "blacklisted": false 2020-01-26T15:21:58.571 INFO:teuthology.orchestra.run.smithi204.stdout:} 2020-01-26T15:21:58.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.618 INFO:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2020-01-26T15:21:58.618 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:21:58.632 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-01-26T15:21:58.633 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:21:58.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.633 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2020-01-26T15:21:58.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.704 INFO:teuthology.orchestra.run.smithi204:> stat --file-system '--printf=%T 2020-01-26T15:21:58.704 INFO:teuthology.orchestra.run.smithi204:> ' -- /home/ubuntu/cephtest/mnt.0 2020-01-26T15:21:58.714 INFO:teuthology.orchestra.run.smithi204.stdout:fuseblk 2020-01-26T15:21:58.714 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-01-26T15:21:58.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:21:58.714 INFO:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-01-26T15:21:58.785 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:21:58.816 INFO:teuthology.task.print:**** done mimic client 2020-01-26T15:21:58.816 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:21:58.832 INFO:teuthology.task.print:**** done fsstress 2020-01-26T15:21:58.832 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2020-01-26T15:21:58.844 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:21:58.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.942 7f6f57b54700 1 Processor -- start 2020-01-26T15:21:58.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.942 7f6f57b54700 1 -- - start start 2020-01-26T15:21:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.942 7f6f57b54700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5014bb10 con 0 2020-01-26T15:21:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.942 7f6f57b54700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5014beb0 con 0 2020-01-26T15:21:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f55b7a700 1 -- 172.21.15.129:0/2274891160 learned_addr learned my addr 172.21.15.129:0/2274891160 2020-01-26T15:21:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f400039b0 con 0x7f6f501480d0 2020-01-26T15:21:58.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2989450503 0 0) 0x7f6f40003d30 con 0x7f6f501480d0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6f3c002a20 con 0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f440022a0 con 0x7f6f5014b3d0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (693561692 0 0) 0x7f6f440025a0 con 0x7f6f5014b3d0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6f3c0046b0 con 0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4176637953 0 0) 0x7f6f40004300 con 0x7f6f501480d0 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 >> 172.21.15.129:6790/0 conn(0x7f6f5014b3d0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:21:58.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5007a930 con 0 2020-01-26T15:21:58.949 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6f500e9ff0 con 0x7f6f501480d0 2020-01-26T15:21:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f54b78700 1 -- 172.21.15.129:0/2274891160 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f400013d0 con 0x7f6f501480d0 2020-01-26T15:21:58.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f57b54700 1 -- 172.21.15.129:0/2274891160 >> 172.21.15.129:6791/0 conn(0x7f6f501480d0 :-1 s=STATE_OPEN pgs=89 cs=1 l=1).mark_down 2020-01-26T15:21:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f57b54700 1 -- 172.21.15.129:0/2274891160 shutdown_connections 2020-01-26T15:21:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f57b54700 1 -- 172.21.15.129:0/2274891160 shutdown_connections 2020-01-26T15:21:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f57b54700 1 -- 172.21.15.129:0/2274891160 wait complete. 2020-01-26T15:21:58.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.946 7f6f57b54700 1 -- 172.21.15.129:0/2274891160 >> 172.21.15.129:0/2274891160 conn(0x7f6f50144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 Processor -- start 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 -- - start start 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500a3ec0 con 0 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500a53e0 con 0 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f55379700 1 -- 172.21.15.129:0/712875192 learned_addr learned my addr 172.21.15.129:0/712875192 2020-01-26T15:21:58.957 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f440020e0 con 0x7f6f500a34d0 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f400011d0 con 0x7f6f50095d50 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2193296169 0 0) 0x7f6f440023e0 con 0x7f6f500a34d0 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6f30002df0 con 0 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (510609453 0 0) 0x7f6f40003700 con 0x7f6f50095d50 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f6f30004620 con 0 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (73990136 0 0) 0x7f6f44000e50 con 0x7f6f500a34d0 2020-01-26T15:21:58.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f30004df0 con 0 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3628128781 0 0) 0x7f6f40003a80 con 0x7f6f50095d50 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f30006570 con 0 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (892777670 0 0) 0x7f6f44001420 con 0x7f6f500a34d0 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 >> 172.21.15.129:6789/0 conn(0x7f6f50095d50 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5007ab90 con 0 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500712f0 con 0 2020-01-26T15:21:58.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f57b54700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500a6d10 con 0 2020-01-26T15:21:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f6f44000bf0 con 0x7f6f500a34d0 2020-01-26T15:21:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f6f44001850 con 0x7f6f500a34d0 2020-01-26T15:21:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f6f44001a90 con 0x7f6f500a34d0 2020-01-26T15:21:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.950 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f6f44005c90 con 0x7f6f500a34d0 2020-01-26T15:21:58.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.958 7f6f57b54700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c002070 con 0 2020-01-26T15:21:58.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:58.962 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f6f44004890 con 0x7f6f500a34d0 2020-01-26T15:21:59.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.054 7f6f57b54700 1 -- 172.21.15.129:0/712875192 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f2c001220 con 0 2020-01-26T15:21:59.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.054 7f6f4effd700 1 -- 172.21.15.129:0/712875192 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 2414052494) 0x7f6f44004070 con 0x7f6f500a34d0 2020-01-26T15:21:59.057 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:59.058 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:52.217088","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:21:59.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 >> 172.21.15.129:6800/11038 conn(0x7f6f300072a0 :-1 s=STATE_OPEN pgs=74 cs=1 l=1).mark_down 2020-01-26T15:21:59.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 >> 172.21.15.129:6791/0 conn(0x7f6f500a34d0 :-1 s=STATE_OPEN pgs=90 cs=1 l=1).mark_down 2020-01-26T15:21:59.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 shutdown_connections 2020-01-26T15:21:59.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 shutdown_connections 2020-01-26T15:21:59.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 wait complete. 2020-01-26T15:21:59.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.058 7f6f57b54700 1 -- 172.21.15.129:0/712875192 >> 172.21.15.129:0/712875192 conn(0x7f6f500996b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:40.257840', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'rbd': {}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:42.851862', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26 15:21:43.236142', u'quota_max_bytes': 0, u'erasure_code_profile': u'', u'expected_num_objects': 0, u'size': 2, u'snap_seq': 0, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'snap_epoch': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:21:59.070 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:21:59.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.166 7fb1a296c700 1 Processor -- start 2020-01-26T15:21:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- - start start 2020-01-26T15:21:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c14bb40 con 0 2020-01-26T15:21:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c14bee0 con 0 2020-01-26T15:21:59.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a0992700 1 -- 172.21.15.129:0/1574610250 learned_addr learned my addr 172.21.15.129:0/1574610250 2020-01-26T15:21:59.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb18c0039b0 con 0x7fb19c148100 2020-01-26T15:21:59.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (828136199 0 0) 0x7fb18c003d30 con 0x7fb19c148100 2020-01-26T15:21:59.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb17c002a20 con 0 2020-01-26T15:21:59.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb1840022a0 con 0x7fb19c14b400 2020-01-26T15:21:59.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2250300986 0 0) 0x7fb1840025a0 con 0x7fb19c14b400 2020-01-26T15:21:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb17c0046b0 con 0 2020-01-26T15:21:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3423746883 0 0) 0x7fb18c004300 con 0x7fb19c148100 2020-01-26T15:21:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 >> 172.21.15.129:6791/0 conn(0x7fb19c14b400 :-1 s=STATE_OPEN pgs=91 cs=1 l=1).mark_down 2020-01-26T15:21:59.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c07a8a0 con 0 2020-01-26T15:21:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb19c0ea020 con 0x7fb19c148100 2020-01-26T15:21:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb19b7fe700 1 -- 172.21.15.129:0/1574610250 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb18c0013d0 con 0x7fb19c148100 2020-01-26T15:21:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- 172.21.15.129:0/1574610250 >> 172.21.15.129:6789/0 conn(0x7fb19c148100 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:21:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- 172.21.15.129:0/1574610250 shutdown_connections 2020-01-26T15:21:59.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- 172.21.15.129:0/1574610250 shutdown_connections 2020-01-26T15:21:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- 172.21.15.129:0/1574610250 wait complete. 2020-01-26T15:21:59.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.170 7fb1a296c700 1 -- 172.21.15.129:0/1574610250 >> 172.21.15.129:0/1574610250 conn(0x7fb19c144030 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb1a296c700 1 Processor -- start 2020-01-26T15:21:59.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb1a296c700 1 -- - start start 2020-01-26T15:21:59.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb1a296c700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0a3c70 con 0 2020-01-26T15:21:59.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb1a296c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c0a6a40 con 0 2020-01-26T15:21:59.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb1a0992700 1 -- 172.21.15.129:0/4084248844 learned_addr learned my addr 172.21.15.129:0/4084248844 2020-01-26T15:21:59.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb18c0011d0 con 0x7fb19c0a3280 2020-01-26T15:21:59.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1771777063 0 0) 0x7fb18c003700 con 0x7fb19c0a3280 2020-01-26T15:21:59.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb180002960 con 0 2020-01-26T15:21:59.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb184002ae0 con 0x7fb19c0a6290 2020-01-26T15:21:59.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (891557812 0 0) 0x7fb1840020e0 con 0x7fb19c0a6290 2020-01-26T15:21:59.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fb180004620 con 0 2020-01-26T15:21:59.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1672919353 0 0) 0x7fb18c003a80 con 0x7fb19c0a3280 2020-01-26T15:21:59.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb180002ee0 con 0 2020-01-26T15:21:59.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3638561762 0 0) 0x7fb184002350 con 0x7fb19c0a6290 2020-01-26T15:21:59.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb180003540 con 0 2020-01-26T15:21:59.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2212543187 0 0) 0x7fb1840010f0 con 0x7fb19c0a6290 2020-01-26T15:21:59.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.174 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 >> 172.21.15.129:6791/0 conn(0x7fb19c0a3280 :-1 s=STATE_OPEN pgs=92 cs=1 l=1).mark_down 2020-01-26T15:21:59.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c07ab00 con 0 2020-01-26T15:21:59.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c0b28c0 con 0 2020-01-26T15:21:59.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fb19c116eb0 con 0x7fb19c0a6290 2020-01-26T15:21:59.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c18b1d0 con 0 2020-01-26T15:21:59.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fb184001360 con 0x7fb19c0a6290 2020-01-26T15:21:59.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fb184002ed0 con 0x7fb19c0a6290 2020-01-26T15:21:59.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.178 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fb184003250 con 0x7fb19c0a6290 2020-01-26T15:21:59.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.182 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c07ae80 con 0 2020-01-26T15:21:59.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.186 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fb19c07ae80 con 0x7fb19c0a6290 2020-01-26T15:21:59.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 --> 172.21.15.129:6789/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fb19c073250 con 0 2020-01-26T15:21:59.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb199ffb700 1 -- 172.21.15.129:0/4084248844 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (3245944037 0 265718887) 0x7fb1840018e0 con 0x7fb19c0a6290 2020-01-26T15:21:59.284 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:59.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 >> 172.21.15.129:6800/11038 conn(0x7fb180006e70 :-1 s=STATE_OPEN pgs=75 cs=1 l=1).mark_down 2020-01-26T15:21:59.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 >> 172.21.15.129:6789/0 conn(0x7fb19c0a6290 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:21:59.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 shutdown_connections 2020-01-26T15:21:59.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 shutdown_connections 2020-01-26T15:21:59.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 wait complete. 2020-01-26T15:21:59.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.282 7fb1a296c700 1 -- 172.21.15.129:0/4084248844 >> 172.21.15.129:0/4084248844 conn(0x7fb19c0993a0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.295 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:21:59.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.386 7fa462273700 1 Processor -- start 2020-01-26T15:21:59.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.386 7fa462273700 1 -- - start start 2020-01-26T15:21:59.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c14bb50 con 0 2020-01-26T15:21:59.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c14bef0 con 0 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa4537fe700 1 -- 172.21.15.129:0/2541028542 learned_addr learned my addr 172.21.15.129:0/2541028542 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa44c0022a0 con 0x7fa45c148110 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3830232478 0 0) 0x7fa44c002620 con 0x7fa45c148110 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa43c002a20 con 0 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4440035b0 con 0x7fa45c14b410 2020-01-26T15:21:59.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (596986482 0 0) 0x7fa4440038b0 con 0x7fa45c14b410 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa43c0046c0 con 0 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2565133221 0 0) 0x7fa44c002bf0 con 0x7fa45c148110 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 >> 172.21.15.129:6790/0 conn(0x7fa45c14b410 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c07a8b0 con 0 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa45c0ea030 con 0x7fa45c148110 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa45b7fe700 1 -- 172.21.15.129:0/2541028542 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa44c001050 con 0x7fa45c148110 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- 172.21.15.129:0/2541028542 >> 172.21.15.129:6789/0 conn(0x7fa45c148110 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:21:59.395 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- 172.21.15.129:0/2541028542 shutdown_connections 2020-01-26T15:21:59.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- 172.21.15.129:0/2541028542 shutdown_connections 2020-01-26T15:21:59.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- 172.21.15.129:0/2541028542 wait complete. 2020-01-26T15:21:59.396 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- 172.21.15.129:0/2541028542 >> 172.21.15.129:0/2541028542 conn(0x7fa45c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 Processor -- start 2020-01-26T15:21:59.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- - start start 2020-01-26T15:21:59.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0a3ca0 con 0 2020-01-26T15:21:59.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.390 7fa462273700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45c0a5150 con 0 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa45bfff700 1 -- 172.21.15.129:0/4022294818 learned_addr learned my addr 172.21.15.129:0/4022294818 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa444003580 con 0x7fa45c095be0 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1661403613 0 0) 0x7fa444003950 con 0x7fa45c095be0 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa440002960 con 0 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa44c001010 con 0x7fa45c0a33a0 2020-01-26T15:21:59.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1962828564 0 0) 0x7fa44c002070 con 0x7fa45c0a33a0 2020-01-26T15:21:59.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa440004620 con 0 2020-01-26T15:21:59.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (822960158 0 0) 0x7fa444003f20 con 0x7fa45c095be0 2020-01-26T15:21:59.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa440002ee0 con 0 2020-01-26T15:21:59.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (385476046 0 0) 0x7fa44c002400 con 0x7fa45c0a33a0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa440003540 con 0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (565868790 0 0) 0x7fa4440010f0 con 0x7fa45c095be0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 >> 172.21.15.129:6789/0 conn(0x7fa45c0a33a0 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c07ab10 con 0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa462273700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c0b26e0 con 0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa462273700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c0a6b40 con 0 2020-01-26T15:21:59.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa45c116ec0 con 0x7fa45c095be0 2020-01-26T15:21:59.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa444001520 con 0x7fa45c095be0 2020-01-26T15:21:59.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa444004260 con 0x7fa45c095be0 2020-01-26T15:21:59.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.394 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fa444005f40 con 0x7fa45c095be0 2020-01-26T15:21:59.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.402 7fa462273700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa434002070 con 0 2020-01-26T15:21:59.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.406 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa444001a10 con 0x7fa45c095be0 2020-01-26T15:21:59.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 --> 172.21.15.129:6791/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fa4340012a0 con 0 2020-01-26T15:21:59.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa459ffb700 1 -- 172.21.15.129:0/4022294818 <== mon.2 172.21.15.129:6791/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v16) v1 ==== 104+0+10 (874748752 0 265718887) 0x7fa444004a00 con 0x7fa45c095be0 2020-01-26T15:21:59.500 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:59.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 >> 172.21.15.129:6800/11038 conn(0x7fa440006290 :-1 s=STATE_OPEN pgs=76 cs=1 l=1).mark_down 2020-01-26T15:21:59.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 >> 172.21.15.129:6791/0 conn(0x7fa45c095be0 :-1 s=STATE_OPEN pgs=93 cs=1 l=1).mark_down 2020-01-26T15:21:59.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 shutdown_connections 2020-01-26T15:21:59.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 shutdown_connections 2020-01-26T15:21:59.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 wait complete. 2020-01-26T15:21:59.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.498 7fa462273700 1 -- 172.21.15.129:0/4022294818 >> 172.21.15.129:0/4022294818 conn(0x7fa45c0994b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.511 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:21:59.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 Processor -- start 2020-01-26T15:21:59.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- - start start 2020-01-26T15:21:59.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c14bb50 con 0 2020-01-26T15:21:59.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c14bef0 con 0 2020-01-26T15:21:59.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb20fb6700 1 -- 172.21.15.129:0/4132215173 learned_addr learned my addr 172.21.15.129:0/4132215173 2020-01-26T15:21:59.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb0c003630 con 0x7ffb1c148110 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3553219017 0 0) 0x7ffb0c0039b0 con 0x7ffb1c148110 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ffb08002a20 con 0 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb10002620 con 0x7ffb1c14b410 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1543840473 0 0) 0x7ffb10002920 con 0x7ffb1c14b410 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ffb080046c0 con 0 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (38533683 0 0) 0x7ffb0c003f80 con 0x7ffb1c148110 2020-01-26T15:21:59.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 >> 172.21.15.129:6789/0 conn(0x7ffb1c14b410 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:21:59.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c07a8b0 con 0 2020-01-26T15:21:59.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ffb0c000bf0 con 0x7ffb1c148110 2020-01-26T15:21:59.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb1b7fe700 1 -- 172.21.15.129:0/4132215173 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb0c001050 con 0x7ffb1c148110 2020-01-26T15:21:59.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- 172.21.15.129:0/4132215173 >> 172.21.15.129:6791/0 conn(0x7ffb1c148110 :-1 s=STATE_OPEN pgs=94 cs=1 l=1).mark_down 2020-01-26T15:21:59.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- 172.21.15.129:0/4132215173 shutdown_connections 2020-01-26T15:21:59.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- 172.21.15.129:0/4132215173 shutdown_connections 2020-01-26T15:21:59.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- 172.21.15.129:0/4132215173 wait complete. 2020-01-26T15:21:59.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.606 7ffb22f90700 1 -- 172.21.15.129:0/4132215173 >> 172.21.15.129:0/4132215173 conn(0x7ffb1c144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 Processor -- start 2020-01-26T15:21:59.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 -- - start start 2020-01-26T15:21:59.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c0a3e80 con 0 2020-01-26T15:21:59.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c095eb0 con 0 2020-01-26T15:21:59.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb1bfff700 1 -- 172.21.15.129:0/1374900709 learned_addr learned my addr 172.21.15.129:0/1374900709 2020-01-26T15:21:59.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb0c003f80 con 0x7ffb1c0a3490 2020-01-26T15:21:59.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb10002460 con 0x7ffb1c0a5240 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3137169485 0 0) 0x7ffb0c000ed0 con 0x7ffb1c0a3490 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ffafc002df0 con 0 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3082250347 0 0) 0x7ffb10002760 con 0x7ffb1c0a5240 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ffafc004620 con 0 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1341391458 0 0) 0x7ffb0c0034a0 con 0x7ffb1c0a3490 2020-01-26T15:21:59.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffafc004df0 con 0 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1157177800 0 0) 0x7ffb100011d0 con 0x7ffb1c0a5240 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffafc0034b0 con 0 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1509704170 0 0) 0x7ffb0c001570 con 0x7ffb1c0a3490 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 >> 172.21.15.129:6791/0 conn(0x7ffb1c0a5240 :-1 s=STATE_OPEN pgs=95 cs=1 l=1).mark_down 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c07ab10 con 0 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0711a0 con 0 2020-01-26T15:21:59.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.610 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c0a6c30 con 0 2020-01-26T15:21:59.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.614 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ffb0c001360 con 0x7ffb1c0a3490 2020-01-26T15:21:59.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.614 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ffb0c0017e0 con 0x7ffb1c0a3490 2020-01-26T15:21:59.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.614 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7ffb0c001ae0 con 0x7ffb1c0a3490 2020-01-26T15:21:59.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.614 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7ffb0c005da0 con 0x7ffb1c0a3490 2020-01-26T15:21:59.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.618 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c07ae90 con 0 2020-01-26T15:21:59.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.626 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ffb1c07ae90 con 0x7ffb1c0a3490 2020-01-26T15:21:59.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 --> 172.21.15.129:6790/0 -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ffb1c156410 con 0 2020-01-26T15:21:59.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb19ffb700 1 -- 172.21.15.129:0/1374900709 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v16) v1 ==== 100+0+10 (1654619520 0 265718887) 0x7ffb0c004230 con 0x7ffb1c0a3490 2020-01-26T15:21:59.719 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:21:59.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 >> 172.21.15.129:6800/11038 conn(0x7ffafc0072a0 :-1 s=STATE_OPEN pgs=77 cs=1 l=1).mark_down 2020-01-26T15:21:59.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 >> 172.21.15.129:6790/0 conn(0x7ffb1c0a3490 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:21:59.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 shutdown_connections 2020-01-26T15:21:59.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 shutdown_connections 2020-01-26T15:21:59.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 wait complete. 2020-01-26T15:21:59.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.718 7ffb22f90700 1 -- 172.21.15.129:0/1374900709 >> 172.21.15.129:0/1374900709 conn(0x7ffb1c0996b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.730 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:21:59.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa304faa700 1 Processor -- start 2020-01-26T15:21:59.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa304faa700 1 -- - start start 2020-01-26T15:21:59.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa304faa700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30014bb10 con 0 2020-01-26T15:21:59.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa304faa700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30014beb0 con 0 2020-01-26T15:21:59.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fe570700 1 -- 172.21.15.129:0/949046411 learned_addr learned my addr 172.21.15.129:0/949046411 2020-01-26T15:21:59.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2e80022a0 con 0x7fa3001480d0 2020-01-26T15:21:59.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2f0003630 con 0x7fa30014b3d0 2020-01-26T15:21:59.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2572162826 0 0) 0x7fa2e8002620 con 0x7fa3001480d0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2e0002ea0 con 0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3781863269 0 0) 0x7fa2f0003930 con 0x7fa30014b3d0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2e00046b0 con 0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2141307868 0 0) 0x7fa2e8002b10 con 0x7fa3001480d0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 >> 172.21.15.129:6790/0 conn(0x7fa30014b3d0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.822 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30007a930 con 0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa3000e9ff0 con 0x7fa3001480d0 2020-01-26T15:21:59.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa2fdd6f700 1 -- 172.21.15.129:0/949046411 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2e8001010 con 0x7fa3001480d0 2020-01-26T15:21:59.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa304faa700 1 -- 172.21.15.129:0/949046411 >> 172.21.15.129:6789/0 conn(0x7fa3001480d0 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:21:59.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa304faa700 1 -- 172.21.15.129:0/949046411 shutdown_connections 2020-01-26T15:21:59.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa304faa700 1 -- 172.21.15.129:0/949046411 shutdown_connections 2020-01-26T15:21:59.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa304faa700 1 -- 172.21.15.129:0/949046411 wait complete. 2020-01-26T15:21:59.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.826 7fa304faa700 1 -- 172.21.15.129:0/949046411 >> 172.21.15.129:0/949046411 conn(0x7fa300144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 Processor -- start 2020-01-26T15:21:59.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 -- - start start 2020-01-26T15:21:59.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000a3d70 con 0 2020-01-26T15:21:59.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000a6b40 con 0 2020-01-26T15:21:59.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2fed71700 1 -- 172.21.15.129:0/3964079050 learned_addr learned my addr 172.21.15.129:0/3964079050 2020-01-26T15:21:59.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2f0003470 con 0x7fa3000a6390 2020-01-26T15:21:59.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2919725722 0 0) 0x7fa2f0003cb0 con 0x7fa3000a6390 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2e4002960 con 0 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2e8001010 con 0x7fa3000a3380 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3577607024 0 0) 0x7fa2e8002050 con 0x7fa3000a3380 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa2e4004620 con 0 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1420108119 0 0) 0x7fa2f0000e50 con 0x7fa3000a6390 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2e4002ee0 con 0 2020-01-26T15:21:59.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (74498821 0 0) 0x7fa2e80023e0 con 0x7fa3000a3380 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2e4003540 con 0 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2507465455 0 0) 0x7fa2f0001360 con 0x7fa3000a6390 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 >> 172.21.15.129:6790/0 conn(0x7fa3000a3380 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30007ab90 con 0 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000b27b0 con 0 2020-01-26T15:21:59.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa304faa700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30018b200 con 0 2020-01-26T15:21:59.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa300116e80 con 0x7fa3000a6390 2020-01-26T15:21:59.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa2f0001790 con 0x7fa3000a6390 2020-01-26T15:21:59.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa2f0001a90 con 0x7fa3000a6390 2020-01-26T15:21:59.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.830 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fa2f0005dd0 con 0x7fa3000a6390 2020-01-26T15:21:59.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.838 7fa304faa700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d8002070 con 0 2020-01-26T15:21:59.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.842 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa2f0004210 con 0x7fa3000a6390 2020-01-26T15:21:59.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.930 7fa304faa700 1 -- 172.21.15.129:0/3964079050 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2d80011d0 con 0 2020-01-26T15:21:59.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa2f7fff700 1 -- 172.21.15.129:0/3964079050 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2250 (3717936808 0 1722169651) 0x7fa2f00044b0 con 0x7fa3000a6390 2020-01-26T15:21:59.935 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 5 2020-01-26T15:21:59.935 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:21:59.935 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:21:46.806578","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:21:59.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 >> 172.21.15.129:6800/11038 conn(0x7fa2e4006f20 :-1 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down 2020-01-26T15:21:59.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 >> 172.21.15.129:6789/0 conn(0x7fa3000a6390 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-01-26T15:21:59.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 shutdown_connections 2020-01-26T15:21:59.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 shutdown_connections 2020-01-26T15:21:59.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 wait complete. 2020-01-26T15:21:59.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:21:59.934 7fa304faa700 1 -- 172.21.15.129:0/3964079050 >> 172.21.15.129:0/3964079050 conn(0x7fa300099470 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:21:59.945 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:22:00.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 Processor -- start 2020-01-26T15:22:00.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- - start start 2020-01-26T15:22:00.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf814bb10 con 0 2020-01-26T15:22:00.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf814beb0 con 0 2020-01-26T15:22:00.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf7027700 1 -- 172.21.15.129:0/2225456637 learned_addr learned my addr 172.21.15.129:0/2225456637 2020-01-26T15:22:00.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde8003630 con 0x7fbdf81480d0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (398601576 0 0) 0x7fbde80039b0 con 0x7fbdf81480d0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbdd8002a20 con 0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde00022a0 con 0x7fbdf814b3d0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2596204279 0 0) 0x7fbde00025a0 con 0x7fbdf814b3d0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbdd80046c0 con 0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2939904887 0 0) 0x7fbde8003f80 con 0x7fbdf81480d0 2020-01-26T15:22:00.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 >> 172.21.15.129:6789/0 conn(0x7fbdf814b3d0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf807a930 con 0 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbdf80e9ff0 con 0x7fbdf81480d0 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdf6826700 1 -- 172.21.15.129:0/2225456637 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde8001050 con 0x7fbdf81480d0 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- 172.21.15.129:0/2225456637 >> 172.21.15.129:6791/0 conn(0x7fbdf81480d0 :-1 s=STATE_OPEN pgs=96 cs=1 l=1).mark_down 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- 172.21.15.129:0/2225456637 shutdown_connections 2020-01-26T15:22:00.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- 172.21.15.129:0/2225456637 shutdown_connections 2020-01-26T15:22:00.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- 172.21.15.129:0/2225456637 wait complete. 2020-01-26T15:22:00.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.038 7fbdfd07c700 1 -- 172.21.15.129:0/2225456637 >> 172.21.15.129:0/2225456637 conn(0x7fbdf8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:00.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 Processor -- start 2020-01-26T15:22:00.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 -- - start start 2020-01-26T15:22:00.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80a3d30 con 0 2020-01-26T15:22:00.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80a51e0 con 0 2020-01-26T15:22:00.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf7027700 1 -- 172.21.15.129:0/2182542120 learned_addr learned my addr 172.21.15.129:0/2182542120 2020-01-26T15:22:00.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde8000e50 con 0x7fbdf80a3430 2020-01-26T15:22:00.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3851304121 0 0) 0x7fbde8001570 con 0x7fbdf80a3430 2020-01-26T15:22:00.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbddc002960 con 0 2020-01-26T15:22:00.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde0002ae0 con 0x7fbdf8095c70 2020-01-26T15:22:00.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3182949244 0 0) 0x7fbde00020b0 con 0x7fbdf8095c70 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fbddc004620 con 0 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (948492590 0 0) 0x7fbde80019c0 con 0x7fbdf80a3430 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbddc002ee0 con 0 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2480931715 0 0) 0x7fbde0002560 con 0x7fbdf8095c70 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbddc003540 con 0 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3942877616 0 0) 0x7fbde00010f0 con 0x7fbdf8095c70 2020-01-26T15:22:00.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 >> 172.21.15.129:6791/0 conn(0x7fbdf80a3430 :-1 s=STATE_OPEN pgs=97 cs=1 l=1).mark_down 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf807ab90 con 0 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80b27b0 con 0 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf80a6cb0 con 0 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fbdf8116e80 con 0x7fbdf8095c70 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fbde0001520 con 0x7fbdf8095c70 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fbde0002e60 con 0x7fbdf8095c70 2020-01-26T15:22:00.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.042 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fbde0004a80 con 0x7fbdf8095c70 2020-01-26T15:22:00.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.050 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0002070 con 0 2020-01-26T15:22:00.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.054 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fbde0001970 con 0x7fbdf8095c70 2020-01-26T15:22:00.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.146 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdd0001220 con 0 2020-01-26T15:22:00.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.146 7fbdf5023700 1 -- 172.21.15.129:0/2182542120 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+6330 (1054498076 0 2414052494) 0x7fbde00034b0 con 0x7fbdf8095c70 2020-01-26T15:22:00.150 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:00.150 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26 15:21:30.833373","modified":"2020-01-26 15:21:52.217088","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.950000,"backfillfull_ratio":0.900000,"nearfull_ratio":0.850000,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26 15:21:40.257840","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"11","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26 15:21:42.851862","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26 15:21:43.236142","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_num":8,"pg_placement_num":8,"last_change":"14","last_force_op_resend":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1.000000,"primary_affinity":1.000000,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0.000000,"laggy_interval":0,"features":4611087854031667195,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[]} 2020-01-26T15:22:00.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 >> 172.21.15.129:6800/11038 conn(0x7fbddc006e70 :-1 s=STATE_OPEN pgs=79 cs=1 l=1).mark_down 2020-01-26T15:22:00.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 >> 172.21.15.129:6790/0 conn(0x7fbdf8095c70 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:22:00.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 shutdown_connections 2020-01-26T15:22:00.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 shutdown_connections 2020-01-26T15:22:00.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 wait complete. 2020-01-26T15:22:00.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.150 7fbdfd07c700 1 -- 172.21.15.129:0/2182542120 >> 172.21.15.129:0/2182542120 conn(0x7fbdf8099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:00.161 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2020-01-26T15:22:00.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c3c17700 1 Processor -- start 2020-01-26T15:22:00.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c3c17700 1 -- - start start 2020-01-26T15:22:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c3c17700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc14bb50 con 0 2020-01-26T15:22:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c3c17700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc14bef0 con 0 2020-01-26T15:22:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c143c700 1 -- 172.21.15.129:0/2499598613 learned_addr learned my addr 172.21.15.129:0/2499598613 2020-01-26T15:22:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4b80022a0 con 0x7fa4bc148110 2020-01-26T15:22:00.264 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4ac003630 con 0x7fa4bc14b410 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2417023372 0 0) 0x7fa4b8002620 con 0x7fa4bc148110 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa4a4002ea0 con 0 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3083703327 0 0) 0x7fa4ac0039b0 con 0x7fa4bc14b410 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa4a40046b0 con 0 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4002944214 0 0) 0x7fa4ac003e50 con 0x7fa4bc14b410 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 >> 172.21.15.129:6790/0 conn(0x7fa4bc148110 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:22:00.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.258 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc07a8b0 con 0 2020-01-26T15:22:00.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa4bc116ec0 con 0x7fa4bc14b410 2020-01-26T15:22:00.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c0c3b700 1 -- 172.21.15.129:0/2499598613 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4ac001010 con 0x7fa4bc14b410 2020-01-26T15:22:00.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- 172.21.15.129:0/2499598613 >> 172.21.15.129:6789/0 conn(0x7fa4bc14b410 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:22:00.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- 172.21.15.129:0/2499598613 shutdown_connections 2020-01-26T15:22:00.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- 172.21.15.129:0/2499598613 shutdown_connections 2020-01-26T15:22:00.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- 172.21.15.129:0/2499598613 wait complete. 2020-01-26T15:22:00.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- 172.21.15.129:0/2499598613 >> 172.21.15.129:0/2499598613 conn(0x7fa4bc144040 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 Processor -- start 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- - start start 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0a3c70 con 0 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c3c17700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0a6a40 con 0 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4c1c3d700 1 -- 172.21.15.129:0/3866525491 learned_addr learned my addr 172.21.15.129:0/3866525491 2020-01-26T15:22:00.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.262 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4b8001ff0 con 0x7fa4bc0a3280 2020-01-26T15:22:00.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1947213789 0 0) 0x7fa4b8002330 con 0x7fa4bc0a3280 2020-01-26T15:22:00.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa49c002960 con 0 2020-01-26T15:22:00.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4ac000e50 con 0x7fa4bc0a6290 2020-01-26T15:22:00.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2861115798 0 0) 0x7fa4ac003440 con 0x7fa4bc0a6290 2020-01-26T15:22:00.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa49c004620 con 0 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4106849443 0 0) 0x7fa4b8000e50 con 0x7fa4bc0a3280 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa49c002ee0 con 0 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2929814505 0 0) 0x7fa4ac0037d0 con 0x7fa4bc0a6290 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa49c003540 con 0 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (2164906973 0 0) 0x7fa4b80014e0 con 0x7fa4bc0a3280 2020-01-26T15:22:00.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 >> 172.21.15.129:6791/0 conn(0x7fa4bc0a6290 :-1 s=STATE_OPEN pgs=98 cs=1 l=1).mark_down 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc07ab10 con 0 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0b2900 con 0 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc18b1e0 con 0 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa4b8000bf0 con 0x7fa4bc0a3280 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4b8001910 con 0x7fa4bc0a3280 2020-01-26T15:22:00.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa4b80044b0 con 0x7fa4bc0a3280 2020-01-26T15:22:00.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.266 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fa4b8005fc0 con 0x7fa4bc0a3280 2020-01-26T15:22:00.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.270 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa498002070 con 0 2020-01-26T15:22:00.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.274 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa4b8004920 con 0x7fa4bc0a3280 2020-01-26T15:22:00.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:00.366 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 --> 172.21.15.129:6790/0 -- mon_command({"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"} v 0) v1 -- 0x7fa498001220 con 0 2020-01-26T15:22:01.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.118 7fa4aaffd700 1 -- 172.21.15.129:0/3866525491 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"var": "max_mds", "prefix": "fs set", "fs_name": "cephfs", "val": "1"}]=0 v6) v1 ==== 105+0+0 (3046767084 0 0) 0x7fa4b8003f90 con 0x7fa4bc0a3280 2020-01-26T15:22:01.135 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 >> 172.21.15.129:6800/11038 conn(0x7fa49c006f20 :-1 s=STATE_OPEN pgs=80 cs=1 l=1).mark_down 2020-01-26T15:22:01.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 >> 172.21.15.129:6790/0 conn(0x7fa4bc0a3280 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:22:01.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 shutdown_connections 2020-01-26T15:22:01.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 shutdown_connections 2020-01-26T15:22:01.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 wait complete. 2020-01-26T15:22:01.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.134 7fa4c3c17700 1 -- 172.21.15.129:0/3866525491 >> 172.21.15.129:0/3866525491 conn(0x7fa4bc099420 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:01.147 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:01.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.238 7f1a520b5700 1 Processor -- start 2020-01-26T15:22:01.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.238 7f1a520b5700 1 -- - start start 2020-01-26T15:22:01.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.238 7f1a520b5700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c14bb10 con 0 2020-01-26T15:22:01.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.238 7f1a520b5700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c14beb0 con 0 2020-01-26T15:22:01.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4b7fe700 1 -- 172.21.15.129:0/4193558959 learned_addr learned my addr 172.21.15.129:0/4193558959 2020-01-26T15:22:01.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a44002620 con 0x7f1a4c1480d0 2020-01-26T15:22:01.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (955497623 0 0) 0x7f1a440029a0 con 0x7f1a4c1480d0 2020-01-26T15:22:01.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a2c002a20 con 0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a34003630 con 0x7f1a4c14b3d0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2196365154 0 0) 0x7f1a34003930 con 0x7f1a4c14b3d0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a2c0046c0 con 0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3566534301 0 0) 0x7f1a44002f70 con 0x7f1a4c1480d0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 >> 172.21.15.129:6789/0 conn(0x7f1a4c14b3d0 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c07a930 con 0 2020-01-26T15:22:01.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1a4c0e9ff0 con 0x7f1a4c1480d0 2020-01-26T15:22:01.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a4affd700 1 -- 172.21.15.129:0/4193558959 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a440013d0 con 0x7f1a4c1480d0 2020-01-26T15:22:01.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a520b5700 1 -- 172.21.15.129:0/4193558959 >> 172.21.15.129:6790/0 conn(0x7f1a4c1480d0 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:22:01.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a520b5700 1 -- 172.21.15.129:0/4193558959 shutdown_connections 2020-01-26T15:22:01.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a520b5700 1 -- 172.21.15.129:0/4193558959 shutdown_connections 2020-01-26T15:22:01.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a520b5700 1 -- 172.21.15.129:0/4193558959 wait complete. 2020-01-26T15:22:01.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.242 7f1a520b5700 1 -- 172.21.15.129:0/4193558959 >> 172.21.15.129:0/4193558959 conn(0x7f1a4c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 Processor -- start 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 -- - start start 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0a3de0 con 0 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0a6bb0 con 0 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a4bfff700 1 -- 172.21.15.129:0/2345582936 learned_addr learned my addr 172.21.15.129:0/2345582936 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a34003e70 con 0x7f1a4c0a6400 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1376330111 0 0) 0x7f1a34003470 con 0x7f1a4c0a6400 2020-01-26T15:22:01.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a30002960 con 0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a44001390 con 0x7f1a4c0a33f0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (843666601 0 0) 0x7f1a44002370 con 0x7f1a4c0a33f0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1a30004620 con 0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2260571673 0 0) 0x7f1a34003990 con 0x7f1a4c0a6400 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1a30002ee0 con 0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (674630531 0 0) 0x7f1a44002700 con 0x7f1a4c0a33f0 2020-01-26T15:22:01.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1a30003540 con 0 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (631005343 0 0) 0x7f1a340010f0 con 0x7f1a4c0a6400 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 >> 172.21.15.129:6791/0 conn(0x7f1a4c0a33f0 :-1 s=STATE_OPEN pgs=99 cs=1 l=1).mark_down 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c07ab90 con 0 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c0b2940 con 0 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c18b200 con 0 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1a34000bf0 con 0x7f1a4c0a6400 2020-01-26T15:22:01.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1a34001520 con 0x7f1a4c0a6400 2020-01-26T15:22:01.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f1a34004260 con 0x7f1a4c0a6400 2020-01-26T15:22:01.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.246 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f1a34001760 con 0x7f1a4c0a6400 2020-01-26T15:22:01.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.254 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24002070 con 0 2020-01-26T15:22:01.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.258 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1a34004ac0 con 0x7f1a4c0a6400 2020-01-26T15:22:01.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.350 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a240011a0 con 0 2020-01-26T15:22:01.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.350 7f1a497fa700 1 -- 172.21.15.129:0/2345582936 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2250 (3889722134 0 941263412) 0x7f1a34004db0 con 0x7f1a4c0a6400 2020-01-26T15:22:01.353 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:01.354 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:01.354 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 6 2020-01-26T15:22:01.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 >> 172.21.15.129:6800/11038 conn(0x7f1a30006ed0 :-1 s=STATE_OPEN pgs=81 cs=1 l=1).mark_down 2020-01-26T15:22:01.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 >> 172.21.15.129:6789/0 conn(0x7f1a4c0a6400 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:22:01.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 shutdown_connections 2020-01-26T15:22:01.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 shutdown_connections 2020-01-26T15:22:01.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 wait complete. 2020-01-26T15:22:01.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.354 7f1a520b5700 1 -- 172.21.15.129:0/2345582936 >> 172.21.15.129:0/2345582936 conn(0x7f1a4c099500 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:01.371 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:01.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff39e655700 1 Processor -- start 2020-01-26T15:22:01.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff39e655700 1 -- - start start 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff39e655700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39814bb10 con 0 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff39e655700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39814beb0 con 0 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff397fff700 1 -- 172.21.15.129:0/764845112 learned_addr learned my addr 172.21.15.129:0/764845112 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff388003630 con 0x7ff3981480d0 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3371470100 0 0) 0x7ff3880039b0 con 0x7ff3981480d0 2020-01-26T15:22:01.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff396ffd700 1 -- 172.21.15.129:0/764845112 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff384002a20 con 0 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.458 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff38c0022a0 con 0x7ff39814b3d0 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4181268139 0 0) 0x7ff38c0025a0 con 0x7ff39814b3d0 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff3840046b0 con 0 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (93460441 0 0) 0x7ff38c002a40 con 0x7ff39814b3d0 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 >> 172.21.15.129:6789/0 conn(0x7ff3981480d0 :-1 s=STATE_OPEN pgs=104 cs=1 l=1).mark_down 2020-01-26T15:22:01.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39807a930 con 0 2020-01-26T15:22:01.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff398116e80 con 0x7ff39814b3d0 2020-01-26T15:22:01.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff396ffd700 1 -- 172.21.15.129:0/764845112 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff38c000e50 con 0x7ff39814b3d0 2020-01-26T15:22:01.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- 172.21.15.129:0/764845112 >> 172.21.15.129:6790/0 conn(0x7ff39814b3d0 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-01-26T15:22:01.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- 172.21.15.129:0/764845112 shutdown_connections 2020-01-26T15:22:01.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- 172.21.15.129:0/764845112 shutdown_connections 2020-01-26T15:22:01.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- 172.21.15.129:0/764845112 wait complete. 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- 172.21.15.129:0/764845112 >> 172.21.15.129:0/764845112 conn(0x7ff398144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 Processor -- start 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- - start start 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980a3cc0 con 0 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.462 7ff39e655700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3980a6a90 con 0 2020-01-26T15:22:01.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff397fff700 1 -- 172.21.15.129:0/986096768 learned_addr learned my addr 172.21.15.129:0/986096768 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff38c002a40 con 0x7ff3980a62e0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2836698782 0 0) 0x7ff38c002080 con 0x7ff3980a62e0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff378002960 con 0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff388003440 con 0x7ff3980a32d0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3211266826 0 0) 0x7ff388003700 con 0x7ff3980a32d0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7ff378004620 con 0 2020-01-26T15:22:01.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1171590201 0 0) 0x7ff38c002400 con 0x7ff3980a62e0 2020-01-26T15:22:01.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff378002ee0 con 0 2020-01-26T15:22:01.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2701990527 0 0) 0x7ff388003970 con 0x7ff3980a32d0 2020-01-26T15:22:01.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff378003540 con 0 2020-01-26T15:22:01.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (1057587120 0 0) 0x7ff3880010f0 con 0x7ff3980a32d0 2020-01-26T15:22:01.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 >> 172.21.15.129:6791/0 conn(0x7ff3980a62e0 :-1 s=STATE_OPEN pgs=100 cs=1 l=1).mark_down 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39807ab90 con 0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff39e655700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3980b2970 con 0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff39e655700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39818b140 con 0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7ff3980e9ff0 con 0x7ff3980a32d0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7ff388001520 con 0x7ff3980a32d0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7ff388001970 con 0x7ff3980a32d0 2020-01-26T15:22:01.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.466 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7ff388004e40 con 0x7ff3980a32d0 2020-01-26T15:22:01.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.474 7ff39e655700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39807af30 con 0 2020-01-26T15:22:01.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.478 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7ff39807af30 con 0x7ff3980a32d0 2020-01-26T15:22:01.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff398070d10 con 0 2020-01-26T15:22:01.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff3957fa700 1 -- 172.21.15.129:0/986096768 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2250 (3889722134 0 941263412) 0x7ff3880047d0 con 0x7ff3980a32d0 2020-01-26T15:22:01.572 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 6 2020-01-26T15:22:01.572 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:01.572 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:01.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 >> 172.21.15.129:6800/11038 conn(0x7ff378006e70 :-1 s=STATE_OPEN pgs=82 cs=1 l=1).mark_down 2020-01-26T15:22:01.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 >> 172.21.15.129:6789/0 conn(0x7ff3980a32d0 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:22:01.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 shutdown_connections 2020-01-26T15:22:01.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 shutdown_connections 2020-01-26T15:22:01.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 wait complete. 2020-01-26T15:22:01.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:01.570 7ff39e655700 1 -- 172.21.15.129:0/986096768 >> 172.21.15.129:0/986096768 conn(0x7ff398099450 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:01.886 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4209}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'-1 (unspecified)', u'data_pools': [3], u'info': {u'gid_4209': {u'standby_for_rank': -1, u'export_targets': [], u'name': u'c', u'incarnation': 4, u'standby_replay': False, u'state_seq': 2, u'standby_for_fscid': -1, u'state': u'up:active', u'gid': 4209, u'features': 4611087854031667195, u'rank': 0, u'standby_for_name': u'', u'addr': u'172.21.15.129:6819/2338999715'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26 15:21:44.187366', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26 15:22:01.117365', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:22:01.886 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:22:01.886 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:22:01.970 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:22:01.970 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:22:01.970 INFO:teuthology.orchestra.run.smithi129.stdout: "whoami": 0, 2020-01-26T15:22:01.971 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4209, 2020-01-26T15:22:01.971 INFO:teuthology.orchestra.run.smithi129.stdout: "want_state": "up:active", 2020-01-26T15:22:01.971 INFO:teuthology.orchestra.run.smithi129.stdout: "state": "up:active", 2020-01-26T15:22:01.971 INFO:teuthology.orchestra.run.smithi129.stdout: "rank_uptime": 16.164856, 2020-01-26T15:22:01.971 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 6, 2020-01-26T15:22:01.972 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch": 16, 2020-01-26T15:22:01.972 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:22:01.972 INFO:teuthology.orchestra.run.smithi129.stdout: "uptime": 16.206271 2020-01-26T15:22:01.972 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:22:01.977 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", "whoami": 0, "id": 4209, "want_state": "up:active", "state": "up:active", "rank_uptime": 16.164856, "mdsmap_epoch": 6, "osdmap_epoch": 16, "osdmap_epoch_barrier": 16, "uptime": 16.206271 } 2020-01-26T15:22:01.977 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-01-26T15:22:01.977 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:22:01.991 INFO:tasks.ceph.mds.a:Stopped 2020-01-26T15:22:01.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-01-26T15:22:01.991 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:22:02.048 INFO:tasks.ceph.mds.b:Stopped 2020-01-26T15:22:07.050 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:07.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.146 7f1bf4f27700 1 Processor -- start 2020-01-26T15:22:07.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.146 7f1bf4f27700 1 -- - start start 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf014bb10 con 0 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf014beb0 con 0 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1beed71700 1 -- 172.21.15.129:0/101969367 learned_addr learned my addr 172.21.15.129:0/101969367 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be40022a0 con 0x7f1bf014b3d0 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3917692801 0 0) 0x7f1be4002620 con 0x7f1bf014b3d0 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bd4002a20 con 0 2020-01-26T15:22:07.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be0003630 con 0x7f1bf01480d0 2020-01-26T15:22:07.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (674066781 0 0) 0x7f1be0003930 con 0x7f1bf01480d0 2020-01-26T15:22:07.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bd40046c0 con 0 2020-01-26T15:22:07.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1115519821 0 0) 0x7f1be4002bf0 con 0x7f1bf014b3d0 2020-01-26T15:22:07.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 >> 172.21.15.129:6789/0 conn(0x7f1bf01480d0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=106 cs=1 l=1).mark_down 2020-01-26T15:22:07.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf007a930 con 0 2020-01-26T15:22:07.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1bf0116e80 con 0x7f1bf014b3d0 2020-01-26T15:22:07.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bedd6f700 1 -- 172.21.15.129:0/101969367 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be4001050 con 0x7f1bf014b3d0 2020-01-26T15:22:07.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- 172.21.15.129:0/101969367 >> 172.21.15.129:6791/0 conn(0x7f1bf014b3d0 :-1 s=STATE_OPEN pgs=101 cs=1 l=1).mark_down 2020-01-26T15:22:07.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- 172.21.15.129:0/101969367 shutdown_connections 2020-01-26T15:22:07.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- 172.21.15.129:0/101969367 shutdown_connections 2020-01-26T15:22:07.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- 172.21.15.129:0/101969367 wait complete. 2020-01-26T15:22:07.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.150 7f1bf4f27700 1 -- 172.21.15.129:0/101969367 >> 172.21.15.129:0/101969367 conn(0x7f1bf0144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:07.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bf4f27700 1 Processor -- start 2020-01-26T15:22:07.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bf4f27700 1 -- - start start 2020-01-26T15:22:07.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bf4f27700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00a3b70 con 0 2020-01-26T15:22:07.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bf4f27700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00a6940 con 0 2020-01-26T15:22:07.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bee570700 1 -- 172.21.15.129:0/1921671330 learned_addr learned my addr 172.21.15.129:0/1921671330 2020-01-26T15:22:07.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be4001010 con 0x7f1bf00a6190 2020-01-26T15:22:07.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3661094532 0 0) 0x7f1be4001ff0 con 0x7f1bf00a6190 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bcc002960 con 0 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be0003e70 con 0x7f1bf00a3180 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3060911527 0 0) 0x7f1be0003440 con 0x7f1bf00a3180 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f1bcc004620 con 0 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2222707199 0 0) 0x7f1be4002620 con 0x7f1bf00a6190 2020-01-26T15:22:07.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bcc002ee0 con 0 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (683094729 0 0) 0x7f1be00037d0 con 0x7f1bf00a3180 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.154 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1bcc003540 con 0 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (4217007522 0 0) 0x7f1be00010f0 con 0x7f1bf00a3180 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 >> 172.21.15.129:6791/0 conn(0x7f1bf00a6190 :-1 s=STATE_OPEN pgs=102 cs=1 l=1).mark_down 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf007ab90 con 0 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf00b2820 con 0 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf018b030 con 0 2020-01-26T15:22:07.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f1bf00e9ff0 con 0x7f1bf00a3180 2020-01-26T15:22:07.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f1be0001520 con 0x7f1bf00a3180 2020-01-26T15:22:07.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f1be0004260 con 0x7f1bf00a3180 2020-01-26T15:22:07.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.158 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f1be0005af0 con 0x7f1bf00a3180 2020-01-26T15:22:07.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.162 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf007af30 con 0 2020-01-26T15:22:07.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.166 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f1bf007af30 con 0x7f1bf00a3180 2020-01-26T15:22:07.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bf0073330 con 0 2020-01-26T15:22:07.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bdffff700 1 -- 172.21.15.129:0/1921671330 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2250 (3889722134 0 941263412) 0x7f1be0001760 con 0x7f1bf00a3180 2020-01-26T15:22:07.259 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 6 2020-01-26T15:22:07.259 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:07.260 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:07.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 >> 172.21.15.129:6800/11038 conn(0x7f1bcc006e90 :-1 s=STATE_OPEN pgs=83 cs=1 l=1).mark_down 2020-01-26T15:22:07.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 >> 172.21.15.129:6790/0 conn(0x7f1bf00a3180 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-01-26T15:22:07.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 shutdown_connections 2020-01-26T15:22:07.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 shutdown_connections 2020-01-26T15:22:07.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 wait complete. 2020-01-26T15:22:07.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:07.258 7f1bf4f27700 1 -- 172.21.15.129:0/1921671330 >> 172.21.15.129:0/1921671330 conn(0x7f1bf00992f0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:12.272 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:12.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.366 7fab2a3e5700 1 Processor -- start 2020-01-26T15:22:12.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.366 7fab2a3e5700 1 -- - start start 2020-01-26T15:22:12.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.366 7fab2a3e5700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2414bb10 con 0 2020-01-26T15:22:12.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.366 7fab2a3e5700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2414beb0 con 0 2020-01-26T15:22:12.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab23fff700 1 -- 172.21.15.129:0/386772500 learned_addr learned my addr 172.21.15.129:0/386772500 2020-01-26T15:22:12.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab180022a0 con 0x7fab2414b3d0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1057167013 0 0) 0x7fab18002620 con 0x7fab2414b3d0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab10002a20 con 0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab140039b0 con 0x7fab241480d0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2187632534 0 0) 0x7fab14003cb0 con 0x7fab241480d0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab100046c0 con 0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1277349249 0 0) 0x7fab14004150 con 0x7fab241480d0 2020-01-26T15:22:12.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 >> 172.21.15.129:6791/0 conn(0x7fab2414b3d0 :-1 s=STATE_OPEN pgs=103 cs=1 l=1).mark_down 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2407a930 con 0 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.1 172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fab240e9ff0 con 0x7fab241480d0 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab22ffd700 1 -- 172.21.15.129:0/386772500 <== mon.1 172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab140011d0 con 0x7fab241480d0 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- 172.21.15.129:0/386772500 >> 172.21.15.129:6790/0 conn(0x7fab241480d0 :-1 s=STATE_OPEN pgs=111 cs=1 l=1).mark_down 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- 172.21.15.129:0/386772500 shutdown_connections 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- 172.21.15.129:0/386772500 shutdown_connections 2020-01-26T15:22:12.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- 172.21.15.129:0/386772500 wait complete. 2020-01-26T15:22:12.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- 172.21.15.129:0/386772500 >> 172.21.15.129:0/386772500 conn(0x7fab24144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:12.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 Processor -- start 2020-01-26T15:22:12.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- - start start 2020-01-26T15:22:12.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab240a3da0 con 0 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.370 7fab2a3e5700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24095dd0 con 0 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab23fff700 1 -- 172.21.15.129:0/2438241759 learned_addr learned my addr 172.21.15.129:0/2438241759 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab180020b0 con 0x7fab240a5160 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2643219030 0 0) 0x7fab18002370 con 0x7fab240a5160 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab04002960 con 0 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab14004150 con 0x7fab240a33b0 2020-01-26T15:22:12.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2753536092 0 0) 0x7fab14003790 con 0x7fab240a33b0 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fab04004620 con 0 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1420086475 0 0) 0x7fab18000e50 con 0x7fab240a5160 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab04002ee0 con 0 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (4049407658 0 0) 0x7fab14003c40 con 0x7fab240a33b0 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab04003540 con 0 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (3691858835 0 0) 0x7fab18001360 con 0x7fab240a5160 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 >> 172.21.15.129:6791/0 conn(0x7fab240a33b0 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=104 cs=1 l=1).mark_down 2020-01-26T15:22:12.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2407ab90 con 0 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab240b29a0 con 0 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fab24116e80 con 0x7fab240a5160 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fab180019a0 con 0x7fab240a5160 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fab240a6aa0 con 0 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fab180033f0 con 0x7fab240a5160 2020-01-26T15:22:12.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.374 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fab180036d0 con 0x7fab240a5160 2020-01-26T15:22:12.382 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.382 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2407af30 con 0 2020-01-26T15:22:12.386 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.386 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fab2407af30 con 0x7fab240a5160 2020-01-26T15:22:12.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 --> 172.21.15.129:6789/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab24073330 con 0 2020-01-26T15:22:12.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab217fa700 1 -- 172.21.15.129:0/2438241759 <== mon.0 172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2250 (3889722134 0 941263412) 0x7fab18002ea0 con 0x7fab240a5160 2020-01-26T15:22:12.479 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 6 2020-01-26T15:22:12.479 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:12.479 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:12.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 >> 172.21.15.129:6800/11038 conn(0x7fab04006ed0 :-1 s=STATE_OPEN pgs=84 cs=1 l=1).mark_down 2020-01-26T15:22:12.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 >> 172.21.15.129:6789/0 conn(0x7fab240a5160 :-1 s=STATE_OPEN pgs=107 cs=1 l=1).mark_down 2020-01-26T15:22:12.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 shutdown_connections 2020-01-26T15:22:12.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 shutdown_connections 2020-01-26T15:22:12.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 wait complete. 2020-01-26T15:22:12.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:12.478 7fab2a3e5700 1 -- 172.21.15.129:0/2438241759 >> 172.21.15.129:0/2438241759 conn(0x7fab240994c0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:17.491 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:17.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 Processor -- start 2020-01-26T15:22:17.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- - start start 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c14bb10 con 0 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c14beb0 con 0 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98427ae700 1 -- 172.21.15.129:0/3577232275 learned_addr learned my addr 172.21.15.129:0/3577232275 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f98340039b0 con 0x7f983c1480d0 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f98300022a0 con 0x7f983c14b3d0 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3968546299 0 0) 0x7f9834003d30 con 0x7f983c1480d0 2020-01-26T15:22:17.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f9828002ea0 con 0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2191750759 0 0) 0x7f98300025a0 con 0x7f983c14b3d0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f98280046a0 con 0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3857631529 0 0) 0x7f98340041d0 con 0x7f983c1480d0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 >> 172.21.15.129:6789/0 conn(0x7f983c14b3d0 :-1 s=STATE_OPEN pgs=108 cs=1 l=1).mark_down 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 --> 172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c07a930 con 0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.2 172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f983c0e9ff0 con 0x7f983c1480d0 2020-01-26T15:22:17.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f98417ac700 1 -- 172.21.15.129:0/3577232275 <== mon.2 172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9834001390 con 0x7f983c1480d0 2020-01-26T15:22:17.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- 172.21.15.129:0/3577232275 >> 172.21.15.129:6791/0 conn(0x7f983c1480d0 :-1 s=STATE_OPEN pgs=105 cs=1 l=1).mark_down 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- 172.21.15.129:0/3577232275 shutdown_connections 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- 172.21.15.129:0/3577232275 shutdown_connections 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- 172.21.15.129:0/3577232275 wait complete. 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.594 7f9844788700 1 -- 172.21.15.129:0/3577232275 >> 172.21.15.129:0/3577232275 conn(0x7f983c144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 Processor -- start 2020-01-26T15:22:17.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 -- - start start 2020-01-26T15:22:17.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0a3d30 con 0 2020-01-26T15:22:17.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 -- - --> 172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c0a6b00 con 0 2020-01-26T15:22:17.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f98427ae700 1 -- 172.21.15.129:0/3496450318 learned_addr learned my addr 172.21.15.129:0/3496450318 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f98340011d0 con 0x7f983c0a3340 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1474024588 0 0) 0x7f9834003760 con 0x7f983c0a3340 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f981c002960 con 0 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.2 172.21.15.129:6791/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9830002ae0 con 0x7f983c0a6350 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.2 172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (24571580 0 0) 0x7f9830002080 con 0x7f983c0a6350 2020-01-26T15:22:17.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6791/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7f981c004620 con 0 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (825430164 0 0) 0x7f9834003bb0 con 0x7f983c0a3340 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f981c002ee0 con 0 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.2 172.21.15.129:6791/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2357574349 0 0) 0x7f9830002530 con 0x7f983c0a6350 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f981c003540 con 0 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (257211612 0 0) 0x7f9834001b50 con 0x7f983c0a3340 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 >> 172.21.15.129:6791/0 conn(0x7f983c0a6350 :-1 s=STATE_OPEN pgs=106 cs=1 l=1).mark_down 2020-01-26T15:22:17.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c07ab90 con 0 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c0b29a0 con 0 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f9844788700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c18b1c0 con 0 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7f9834000f70 con 0x7f983c0a3340 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7f9834001f80 con 0x7f983c0a3340 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7f9834004b00 con 0x7f983c0a3340 2020-01-26T15:22:17.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.598 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7f9834006480 con 0x7f983c0a3340 2020-01-26T15:22:17.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.610 7f9844788700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c07af30 con 0 2020-01-26T15:22:17.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.610 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7f983c07af30 con 0x7f983c0a3340 2020-01-26T15:22:17.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.706 7f9844788700 1 -- 172.21.15.129:0/3496450318 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f983c073330 con 0 2020-01-26T15:22:17.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.706 7f983b7fe700 1 -- 172.21.15.129:0/3496450318 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2250 (3889722134 0 941263412) 0x7f9834004de0 con 0x7f983c0a3340 2020-01-26T15:22:17.709 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 6 2020-01-26T15:22:17.709 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:17.709 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4202,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6817/1853353427","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4},{"gid":4206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.129:6818/3757696416","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:17.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.706 7f9844788700 1 -- 172.21.15.129:0/3496450318 >> 172.21.15.129:6800/11038 conn(0x7f981c006ed0 :-1 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down 2020-01-26T15:22:17.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.706 7f9844788700 1 -- 172.21.15.129:0/3496450318 >> 172.21.15.129:6790/0 conn(0x7f983c0a3340 :-1 s=STATE_OPEN pgs=112 cs=1 l=1).mark_down 2020-01-26T15:22:17.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.710 7f9844788700 1 -- 172.21.15.129:0/3496450318 shutdown_connections 2020-01-26T15:22:17.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.710 7f9844788700 1 -- 172.21.15.129:0/3496450318 shutdown_connections 2020-01-26T15:22:17.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.710 7f9844788700 1 -- 172.21.15.129:0/3496450318 wait complete. 2020-01-26T15:22:17.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:17.710 7f9844788700 1 -- 172.21.15.129:0/3496450318 >> 172.21.15.129:0/3496450318 conn(0x7f983c099410 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:22.720 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:22:22.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.822 7fa4bc922700 1 Processor -- start 2020-01-26T15:22:22.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.822 7fa4bc922700 1 -- - start start 2020-01-26T15:22:22.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.822 7fa4bc922700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b814bb10 con 0 2020-01-26T15:22:22.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.822 7fa4bc922700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b814beb0 con 0 2020-01-26T15:22:22.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.822 7fa4b6025700 1 -- 172.21.15.129:0/1617702031 learned_addr learned my addr 172.21.15.129:0/1617702031 2020-01-26T15:22:22.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a0003630 con 0x7fa4b814b3d0 2020-01-26T15:22:22.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2323507554 0 0) 0x7fa4a00039b0 con 0x7fa4b814b3d0 2020-01-26T15:22:22.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa498002a20 con 0 2020-01-26T15:22:22.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a8002620 con 0x7fa4b81480d0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (1233784524 0 0) 0x7fa4a8002920 con 0x7fa4b81480d0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa4980046c0 con 0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (786178049 0 0) 0x7fa4a0003f80 con 0x7fa4b814b3d0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 >> 172.21.15.129:6790/0 conn(0x7fa4b81480d0 :-1 s=STATE_OPEN pgs=113 cs=1 l=1).mark_down 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 --> 172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b807a930 con 0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.0 172.21.15.129:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa4b8116e80 con 0x7fa4b814b3d0 2020-01-26T15:22:22.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b5824700 1 -- 172.21.15.129:0/1617702031 <== mon.0 172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a0001050 con 0x7fa4b814b3d0 2020-01-26T15:22:22.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- 172.21.15.129:0/1617702031 >> 172.21.15.129:6789/0 conn(0x7fa4b814b3d0 :-1 s=STATE_OPEN pgs=109 cs=1 l=1).mark_down 2020-01-26T15:22:22.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- 172.21.15.129:0/1617702031 shutdown_connections 2020-01-26T15:22:22.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- 172.21.15.129:0/1617702031 shutdown_connections 2020-01-26T15:22:22.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- 172.21.15.129:0/1617702031 wait complete. 2020-01-26T15:22:22.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- 172.21.15.129:0/1617702031 >> 172.21.15.129:0/1617702031 conn(0x7fa4b8144000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:22.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 Processor -- start 2020-01-26T15:22:22.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- - start start 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- - --> 172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80a3f30 con 0 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4bc922700 1 -- - --> 172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b80a36a0 con 0 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.826 7fa4b6826700 1 -- 172.21.15.129:0/2180200131 learned_addr learned my addr 172.21.15.129:0/2180200131 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.0 172.21.15.129:6789/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a8002460 con 0x7fa4b8095d60 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.0 172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (779525129 0 0) 0x7fa4a8002760 con 0x7fa4b8095d60 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa49c002960 con 0 2020-01-26T15:22:22.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a0000e50 con 0x7fa4b80a52f0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (4054257963 0 0) 0x7fa4a0003380 con 0x7fa4b80a52f0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x7fa49c004620 con 0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2552527584 0 0) 0x7fa4a0003710 con 0x7fa4b80a52f0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa49c002ee0 con 0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.0 172.21.15.129:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1045305659 0 0) 0x7fa4a80011d0 con 0x7fa4b8095d60 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa49c003540 con 0 2020-01-26T15:22:22.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (596301803 0 0) 0x7fa4a0001560 con 0x7fa4b80a52f0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 >> 172.21.15.129:6789/0 conn(0x7fa4b8095d60 :-1 s=STATE_OPEN pgs=110 cs=1 l=1).mark_down 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b807ab90 con 0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80712f0 con 0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x7fa4a0001350 con 0x7fa4b80a52f0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 361+0+0 (1477017572 0 0) 0x7fa4a0001990 con 0x7fa4b80a52f0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80a6d70 con 0 2020-01-26T15:22:22.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 7 ==== mgrmap(e 3) v1 ==== 1228+0+0 (490404811 0 0) 0x7fa4a0004660 con 0x7fa4b80a52f0 2020-01-26T15:22:22.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.830 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (2051107912 0 0) 0x7fa4a0004fb0 con 0x7fa4b80a52f0 2020-01-26T15:22:22.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.838 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b807af30 con 0 2020-01-26T15:22:22.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.842 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+77869 (1092875540 0 1191074067) 0x7fa4b807af30 con 0x7fa4b80a52f0 2020-01-26T15:22:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.934 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 --> 172.21.15.129:6790/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b80ba3b0 con 0 2020-01-26T15:22:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.934 7fa4affff700 1 -- 172.21.15.129:0/2180200131 <== mon.1 172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1701 (4058427516 0 3477711533) 0x7fa4a0004970 con 0x7fa4b80a52f0 2020-01-26T15:22:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 7 2020-01-26T15:22:22.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 >> 172.21.15.129:6800/11038 conn(0x7fa49c006ed0 :-1 s=STATE_OPEN pgs=86 cs=1 l=1).mark_down 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 >> 172.21.15.129:6790/0 conn(0x7fa4b80a52f0 :-1 s=STATE_OPEN pgs=114 cs=1 l=1).mark_down 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 shutdown_connections 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 shutdown_connections 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 wait complete. 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26 15:22:22.938 7fa4bc922700 1 -- 172.21.15.129:0/2180200131 >> 172.21.15.129:0/2180200131 conn(0x7fa4b80995b0 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down 2020-01-26T15:22:22.942 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:22:22.943 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26 15:21:44.187366","modified":"2020-01-26 15:22:01.117365","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","standby_for_rank":-1,"standby_for_fscid":-1,"standby_for_name":"","standby_replay":false,"export_targets":[],"features":4611087854031667195}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:22:22.952 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:22:22.963 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2020-01-26T15:22:22.963 INFO:teuthology.run_tasks:Running task install.upgrade... 2020-01-26T15:22:22.977 INFO:teuthology.task.install:project ceph config {'mon.a': None, 'mon.b': None} overrides {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'} 2020-01-26T15:22:22.977 WARNING:teuthology.task.install:remote ubuntu@smithi129.front.sepia.ceph.com came up twice (role mon.b) 2020-01-26T15:22:22.978 INFO:teuthology.task.install:remote ubuntu@smithi129.front.sepia.ceph.com config {'sha1': '084f0502288c3898c3a27b35934ea510597b049d'} 2020-01-26T15:22:22.978 INFO:teuthology.task.install:extra packages: [] 2020-01-26T15:22:22.978 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:22:23.030 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:22:23.036 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:22:23.044 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-01-26T15:22:23.044 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2020-01-26T15:22:23.044 INFO:teuthology.orchestra.run.smithi129:> dpkg-query -W -f '${Version}' ceph-common 2020-01-26T15:22:23.067 INFO:teuthology.orchestra.run.smithi129.stdout:13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:22:23.067 INFO:teuthology.packaging:The installed version of ceph-common is 13.2.8-63-ge1c5fd9-1bionic 2020-01-26T15:22:23.068 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:22:23.158 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:22:23.163 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:22:23.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:22:23.326 INFO:teuthology.task.install:Ceph deb upgrade from 13.2.8-63-ge1c5fd9-1bionic to 15.0.0-9766-g084f050-1bionic 2020-01-26T15:22:23.327 INFO:teuthology.orchestra.run.smithi129:> sudo apt-key list | grep Ceph 2020-01-26T15:22:23.423 INFO:teuthology.orchestra.run.smithi129.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-01-26T15:22:23.482 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-01-26T15:22:23.482 INFO:teuthology.orchestra.run.smithi129.stdout:uid [ unknown] Ceph.com (release key) 2020-01-26T15:22:23.483 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:22:23.532 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:22:23.537 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:22:23.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:22:23.730 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default/ 2020-01-26T15:22:23.731 INFO:teuthology.task.install.deb:Package version is 15.0.0-9766-g084f050-1bionic 2020-01-26T15:22:23.852 INFO:teuthology.orchestra.run.smithi129:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2020-01-26T15:22:23.900 INFO:teuthology.orchestra.run.smithi129:> sudo apt-get update 2020-01-26T15:22:24.160 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic InRelease 2020-01-26T15:22:24.181 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-01-26T15:22:24.195 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-01-26T15:22:24.208 INFO:teuthology.orchestra.run.smithi129.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-01-26T15:22:24.209 INFO:teuthology.orchestra.run.smithi129.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic Release.gpg 2020-01-26T15:22:24.230 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2020-01-26T15:22:24.262 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,610 B] 2020-01-26T15:22:24.276 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-01-26T15:22:24.555 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-01-26T15:22:24.863 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 278 kB in 1s (365 kB/s) 2020-01-26T15:22:26.034 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:22:26.076 INFO:teuthology.orchestra.run.smithi129:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-9766-g084f050-1bionic cephadm=15.0.0-9766-g084f050-1bionic ceph-mds=15.0.0-9766-g084f050-1bionic ceph-mgr=15.0.0-9766-g084f050-1bionic ceph-common=15.0.0-9766-g084f050-1bionic ceph-fuse=15.0.0-9766-g084f050-1bionic ceph-test=15.0.0-9766-g084f050-1bionic radosgw=15.0.0-9766-g084f050-1bionic python3-rados=15.0.0-9766-g084f050-1bionic python3-rgw=15.0.0-9766-g084f050-1bionic python3-cephfs=15.0.0-9766-g084f050-1bionic python3-rbd=15.0.0-9766-g084f050-1bionic libcephfs2=15.0.0-9766-g084f050-1bionic libcephfs-dev=15.0.0-9766-g084f050-1bionic librados2=15.0.0-9766-g084f050-1bionic librbd1=15.0.0-9766-g084f050-1bionic rbd-fuse=15.0.0-9766-g084f050-1bionic 2020-01-26T15:22:26.153 INFO:teuthology.orchestra.run.smithi129.stdout:Reading package lists... 2020-01-26T15:22:26.377 INFO:teuthology.orchestra.run.smithi129.stdout:Building dependency tree... 2020-01-26T15:22:26.378 INFO:teuthology.orchestra.run.smithi129.stdout:Reading state information... 2020-01-26T15:22:26.536 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages were automatically installed and are no longer required: 2020-01-26T15:22:26.537 INFO:teuthology.orchestra.run.smithi129.stdout: formencode-i18n libjs-sphinxdoc libjs-underscore python-bcrypt python-bs4 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-ceph-argparse python-certifi python-chardet python-cherrypy3 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-dnspython python-formencode python-html5lib python-jinja2 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-logutils python-lxml python-mako python-markupsafe python-openid 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-paste python-pastedeploy python-pastescript python-pecan 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-prettytable python-pyinotify python-rbd python-repoze.lru 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-requests python-routes python-scgi python-simplegeneric 2020-01-26T15:22:26.538 INFO:teuthology.orchestra.run.smithi129.stdout: python-simplejson python-singledispatch python-tempita python-urllib3 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout: python-waitress python-webencodings python-webob python-webtest 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout: python-werkzeug 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout:Use 'sudo apt autoremove' to remove them. 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout:The following additional packages will be installed: 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-26T15:22:26.539 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2020-01-26T15:22:26.540 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd librabbitmq4 libradosstriper1 librdkafka1 librgw2 python-attr 2020-01-26T15:22:26.540 INFO:teuthology.orchestra.run.smithi129.stdout: python-funcsigs python-pluggy python-py python-pytest python3-asn1crypto 2020-01-26T15:22:26.540 INFO:teuthology.orchestra.run.smithi129.stdout: python3-attr python3-bcrypt python3-bs4 python3-ceph-argparse 2020-01-26T15:22:26.540 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common python3-cffi-backend python3-cherrypy3 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-26T15:22:26.541 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-26T15:22:26.542 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest python3-werkzeug 2020-01-26T15:22:26.543 INFO:teuthology.orchestra.run.smithi129.stdout:Suggested packages: 2020-01-26T15:22:26.543 INFO:teuthology.orchestra.run.smithi129.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-01-26T15:22:26.543 INFO:teuthology.orchestra.run.smithi129.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-01-26T15:22:26.543 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2020-01-26T15:22:26.543 INFO:teuthology.orchestra.run.smithi129.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python-numpy-doc python3-dev python3-numpy-dbg python-openssl-doc 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python3-openssl-dbg httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: libjs-mochikit python-pecan-doc python-pil-doc python3-pil-dbg 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2020-01-26T15:22:26.544 INFO:teuthology.orchestra.run.smithi129.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2020-01-26T15:22:26.545 INFO:teuthology.orchestra.run.smithi129.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2020-01-26T15:22:26.545 INFO:teuthology.orchestra.run.smithi129.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2020-01-26T15:22:26.545 INFO:teuthology.orchestra.run.smithi129.stdout: python3-watchdog python-werkzeug-doc 2020-01-26T15:22:26.632 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be REMOVED: 2020-01-26T15:22:26.633 INFO:teuthology.orchestra.run.smithi129.stdout: python-cephfs python-rados python-rgw 2020-01-26T15:22:26.633 INFO:teuthology.orchestra.run.smithi129.stdout:The following NEW packages will be installed: 2020-01-26T15:22:26.633 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-01-26T15:22:26.633 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook cephadm 2020-01-26T15:22:26.634 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq4 librdkafka1 python-attr python-funcsigs python-pluggy python-py 2020-01-26T15:22:26.634 INFO:teuthology.orchestra.run.smithi129.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-01-26T15:22:26.634 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common python3-cffi-backend python3-cherrypy3 2020-01-26T15:22:26.634 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-01-26T15:22:26.635 INFO:teuthology.orchestra.run.smithi129.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-joblib 2020-01-26T15:22:26.635 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-01-26T15:22:26.635 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-01-26T15:22:26.635 INFO:teuthology.orchestra.run.smithi129.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-01-26T15:22:26.636 INFO:teuthology.orchestra.run.smithi129.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-01-26T15:22:26.637 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-01-26T15:22:26.637 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest python3-werkzeug 2020-01-26T15:22:26.637 INFO:teuthology.orchestra.run.smithi129.stdout:The following packages will be upgraded: 2020-01-26T15:22:26.637 INFO:teuthology.orchestra.run.smithi129.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mon ceph-osd 2020-01-26T15:22:26.638 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test libcephfs-dev libcephfs2 librados2 libradosstriper1 librbd1 2020-01-26T15:22:26.638 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 python3-ceph-argparse python3-cephfs python3-rados python3-rbd 2020-01-26T15:22:26.638 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw radosgw rbd-fuse 2020-01-26T15:22:26.785 INFO:teuthology.orchestra.run.smithi129.stdout:22 upgraded, 75 newly installed, 3 to remove and 53 not upgraded. 2020-01-26T15:22:26.785 INFO:teuthology.orchestra.run.smithi129.stdout:Need to get 149 MB of archives. 2020-01-26T15:22:26.785 INFO:teuthology.orchestra.run.smithi129.stdout:After this operation, 417 MB of additional disk space will be used. 2020-01-26T15:22:26.786 INFO:teuthology.orchestra.run.smithi129.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-9766-g084f050-1bionic [333 kB] 2020-01-26T15:22:26.827 INFO:teuthology.orchestra.run.smithi129.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-01-26T15:22:26.888 INFO:teuthology.orchestra.run.smithi129.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-9766-g084f050-1bionic [5,513 kB] 2020-01-26T15:22:27.060 INFO:teuthology.orchestra.run.smithi129.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-01-26T15:22:27.294 INFO:teuthology.orchestra.run.smithi129.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-9766-g084f050-1bionic [1,396 kB] 2020-01-26T15:22:27.337 INFO:teuthology.orchestra.run.smithi129.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-01-26T15:22:27.354 INFO:teuthology.orchestra.run.smithi129.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-9766-g084f050-1bionic [5,936 kB] 2020-01-26T15:22:27.360 INFO:teuthology.orchestra.run.smithi129.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-01-26T15:22:27.369 INFO:teuthology.orchestra.run.smithi129.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-01-26T15:22:27.407 INFO:teuthology.orchestra.run.smithi129.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-01-26T15:22:27.410 INFO:teuthology.orchestra.run.smithi129.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-01-26T15:22:27.426 INFO:teuthology.orchestra.run.smithi129.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-01-26T15:22:27.459 INFO:teuthology.orchestra.run.smithi129.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-01-26T15:22:27.464 INFO:teuthology.orchestra.run.smithi129.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-01-26T15:22:27.466 INFO:teuthology.orchestra.run.smithi129.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-01-26T15:22:27.468 INFO:teuthology.orchestra.run.smithi129.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-01-26T15:22:27.500 INFO:teuthology.orchestra.run.smithi129.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-01-26T15:22:27.501 INFO:teuthology.orchestra.run.smithi129.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-01-26T15:22:27.502 INFO:teuthology.orchestra.run.smithi129.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-01-26T15:22:27.507 INFO:teuthology.orchestra.run.smithi129.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-01-26T15:22:27.550 INFO:teuthology.orchestra.run.smithi129.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-9766-g084f050-1bionic [1,829 kB] 2020-01-26T15:22:27.581 INFO:teuthology.orchestra.run.smithi129.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-01-26T15:22:27.584 INFO:teuthology.orchestra.run.smithi129.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-01-26T15:22:27.584 INFO:teuthology.orchestra.run.smithi129.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-01-26T15:22:27.610 INFO:teuthology.orchestra.run.smithi129.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-01-26T15:22:27.610 INFO:teuthology.orchestra.run.smithi129.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-9766-g084f050-1bionic [3,772 B] 2020-01-26T15:22:27.611 INFO:teuthology.orchestra.run.smithi129.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-01-26T15:22:27.611 INFO:teuthology.orchestra.run.smithi129.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-9766-g084f050-1bionic [22.7 MB] 2020-01-26T15:22:27.774 INFO:teuthology.orchestra.run.smithi129.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-01-26T15:22:28.103 INFO:teuthology.orchestra.run.smithi129.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-01-26T15:22:28.229 INFO:teuthology.orchestra.run.smithi129.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-01-26T15:22:28.240 INFO:teuthology.orchestra.run.smithi129.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-01-26T15:22:28.242 INFO:teuthology.orchestra.run.smithi129.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-01-26T15:22:28.249 INFO:teuthology.orchestra.run.smithi129.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-01-26T15:22:28.262 INFO:teuthology.orchestra.run.smithi129.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-01-26T15:22:28.356 INFO:teuthology.orchestra.run.smithi129.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-9766-g084f050-1bionic [41.6 MB] 2020-01-26T15:22:28.500 INFO:teuthology.orchestra.run.smithi129.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-01-26T15:22:28.501 INFO:teuthology.orchestra.run.smithi129.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-01-26T15:22:28.790 INFO:teuthology.orchestra.run.smithi129.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-01-26T15:22:28.835 INFO:teuthology.orchestra.run.smithi129.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-01-26T15:22:28.837 INFO:teuthology.orchestra.run.smithi129.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-01-26T15:22:28.874 INFO:teuthology.orchestra.run.smithi129.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-01-26T15:22:28.875 INFO:teuthology.orchestra.run.smithi129.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-01-26T15:22:28.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-01-26T15:22:28.876 INFO:teuthology.orchestra.run.smithi129.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2020-01-26T15:22:28.877 INFO:teuthology.orchestra.run.smithi129.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-01-26T15:22:28.878 INFO:teuthology.orchestra.run.smithi129.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-01-26T15:22:28.878 INFO:teuthology.orchestra.run.smithi129.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-01-26T15:22:28.953 INFO:teuthology.orchestra.run.smithi129.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-01-26T15:22:28.968 INFO:teuthology.orchestra.run.smithi129.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-01-26T15:22:29.133 INFO:teuthology.orchestra.run.smithi129.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-01-26T15:22:29.582 INFO:teuthology.orchestra.run.smithi129.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-01-26T15:22:29.589 INFO:teuthology.orchestra.run.smithi129.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-01-26T15:22:29.628 INFO:teuthology.orchestra.run.smithi129.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-01-26T15:22:29.634 INFO:teuthology.orchestra.run.smithi129.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-01-26T15:22:29.639 INFO:teuthology.orchestra.run.smithi129.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-01-26T15:22:29.663 INFO:teuthology.orchestra.run.smithi129.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-01-26T15:22:29.677 INFO:teuthology.orchestra.run.smithi129.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-01-26T15:22:29.709 INFO:teuthology.orchestra.run.smithi129.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-01-26T15:22:29.717 INFO:teuthology.orchestra.run.smithi129.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-01-26T15:22:29.717 INFO:teuthology.orchestra.run.smithi129.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-01-26T15:22:29.737 INFO:teuthology.orchestra.run.smithi129.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-9766-g084f050-1bionic [5,125 kB] 2020-01-26T15:22:29.743 INFO:teuthology.orchestra.run.smithi129.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-01-26T15:22:29.752 INFO:teuthology.orchestra.run.smithi129.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-01-26T15:22:29.862 INFO:teuthology.orchestra.run.smithi129.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-01-26T15:22:29.864 INFO:teuthology.orchestra.run.smithi129.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-01-26T15:22:29.866 INFO:teuthology.orchestra.run.smithi129.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-01-26T15:22:29.895 INFO:teuthology.orchestra.run.smithi129.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-9766-g084f050-1bionic [18.0 MB] 2020-01-26T15:22:30.009 INFO:teuthology.orchestra.run.smithi129.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-01-26T15:22:30.020 INFO:teuthology.orchestra.run.smithi129.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-01-26T15:22:30.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2020-01-26T15:22:30.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-01-26T15:22:30.021 INFO:teuthology.orchestra.run.smithi129.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-01-26T15:22:30.184 INFO:teuthology.orchestra.run.smithi129.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-01-26T15:22:30.374 INFO:teuthology.orchestra.run.smithi129.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-01-26T15:22:30.487 INFO:teuthology.orchestra.run.smithi129.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-9766-g084f050-1bionic [17.3 kB] 2020-01-26T15:22:30.488 INFO:teuthology.orchestra.run.smithi129.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-9766-g084f050-1bionic [118 kB] 2020-01-26T15:22:30.489 INFO:teuthology.orchestra.run.smithi129.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-9766-g084f050-1bionic [433 kB] 2020-01-26T15:22:30.503 INFO:teuthology.orchestra.run.smithi129.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-9766-g084f050-1bionic [20.5 kB] 2020-01-26T15:22:30.504 INFO:teuthology.orchestra.run.smithi129.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-9766-g084f050-1bionic [99.2 kB] 2020-01-26T15:22:30.508 INFO:teuthology.orchestra.run.smithi129.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-9766-g084f050-1bionic [331 kB] 2020-01-26T15:22:30.518 INFO:teuthology.orchestra.run.smithi129.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-9766-g084f050-1bionic [1,582 kB] 2020-01-26T15:22:30.570 INFO:teuthology.orchestra.run.smithi129.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-9766-g084f050-1bionic [4,627 kB] 2020-01-26T15:22:30.577 INFO:teuthology.orchestra.run.smithi129.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-01-26T15:22:30.610 INFO:teuthology.orchestra.run.smithi129.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-01-26T15:22:30.722 INFO:teuthology.orchestra.run.smithi129.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-9766-g084f050-1bionic [3,047 kB] 2020-01-26T15:22:30.822 INFO:teuthology.orchestra.run.smithi129.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-9766-g084f050-1bionic [18.3 kB] 2020-01-26T15:22:30.822 INFO:teuthology.orchestra.run.smithi129.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-9766-g084f050-1bionic [276 kB] 2020-01-26T15:22:30.831 INFO:teuthology.orchestra.run.smithi129.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-9766-g084f050-1bionic [513 kB] 2020-01-26T15:22:30.848 INFO:teuthology.orchestra.run.smithi129.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-9766-g084f050-1bionic [24.9 kB] 2020-01-26T15:22:30.849 INFO:teuthology.orchestra.run.smithi129.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-9766-g084f050-1bionic [22.5 kB] 2020-01-26T15:22:30.850 INFO:teuthology.orchestra.run.smithi129.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-9766-g084f050-1bionic [3,434 kB] 2020-01-26T15:22:30.963 INFO:teuthology.orchestra.run.smithi129.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-9766-g084f050-1bionic [34.1 kB] 2020-01-26T15:22:30.963 INFO:teuthology.orchestra.run.smithi129.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-9766-g084f050-1bionic [7,888 kB] 2020-01-26T15:22:31.224 INFO:teuthology.orchestra.run.smithi129.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-9766-g084f050-1bionic [3,888 B] 2020-01-26T15:22:31.224 INFO:teuthology.orchestra.run.smithi129.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-9766-g084f050-1bionic [13.4 kB] 2020-01-26T15:22:31.224 INFO:teuthology.orchestra.run.smithi129.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-01-24-1408/084f0502288c3898c3a27b35934ea510597b049d/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-9766-g084f050-1bionic [62.0 kB] 2020-01-26T15:22:32.073 INFO:teuthology.orchestra.run.smithi129.stdout:Fetched 149 MB in 5s (32.7 MB/s) 2020-01-26T15:22:32.279 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140481 files and directories currently installed.) 2020-01-26T15:22:32.283 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../0-libradosstriper1_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:32.452 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libradosstriper1 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:32.872 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../1-radosgw_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:32.999 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking radosgw (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:34.176 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../2-ceph-mgr_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:34.348 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:34.977 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../3-ceph-mon_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:35.081 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mon (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:36.038 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../4-ceph-mds_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:36.161 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mds (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:36.722 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../5-ceph_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:36.838 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:37.308 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../6-ceph-osd_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:37.496 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-osd (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:39.534 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../7-ceph-test_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:39.662 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-test (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:43.051 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../8-ceph-base_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:43.253 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-base (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:44.368 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../9-ceph-common_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:44.496 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-common (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:46.266 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140058 files and directories currently installed.) 2020-01-26T15:22:46.270 INFO:teuthology.orchestra.run.smithi129.stdout:Removing python-rgw (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:46.624 INFO:teuthology.orchestra.run.smithi129.stdout:Removing python-cephfs (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:47.259 INFO:teuthology.orchestra.run.smithi129.stdout:Removing python-rados (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:47.775 INFO:teuthology.orchestra.run.smithi129.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140037 files and directories currently installed.) 2020-01-26T15:22:47.778 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../00-libcephfs-dev_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:47.903 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs-dev (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:48.229 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../01-python3-cephfs_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:48.450 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cephfs (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:48.848 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../02-libcephfs2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:48.977 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking libcephfs2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:49.358 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../03-python3-ceph-argparse_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:22:49.571 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-argparse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:49.885 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../04-python3-rgw_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:50.013 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rgw (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:50.351 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../05-python3-rados_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:50.477 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rados (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:50.888 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../06-librbd1_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:51.014 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librbd1 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:51.518 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../07-librgw2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:51.635 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librgw2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:52.371 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../08-librados2_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:22:52.495 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librados2 (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:22:53.099 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-01-26T15:22:53.114 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../09-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-01-26T15:22:53.149 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-26T15:22:53.511 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-01-26T15:22:53.525 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../10-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-01-26T15:22:53.569 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-26T15:22:53.847 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cffi-backend. 2020-01-26T15:22:53.862 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../11-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-01-26T15:22:53.905 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-01-26T15:22:54.194 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-bcrypt. 2020-01-26T15:22:54.207 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../12-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-01-26T15:22:54.255 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-01-26T15:22:54.544 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cherrypy3. 2020-01-26T15:22:54.558 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../13-python3-cherrypy3_8.9.1-2_all.deb ... 2020-01-26T15:22:54.607 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-01-26T15:22:54.976 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-jwt. 2020-01-26T15:22:54.988 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../14-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-01-26T15:22:55.025 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-01-26T15:22:55.378 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-asn1crypto. 2020-01-26T15:22:55.393 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../15-python3-asn1crypto_0.24.0-1_all.deb ... 2020-01-26T15:22:55.436 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-01-26T15:22:55.767 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cryptography. 2020-01-26T15:22:55.781 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../16-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-01-26T15:22:55.825 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-26T15:22:56.187 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-openssl. 2020-01-26T15:22:56.203 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../17-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-01-26T15:22:56.245 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:22:56.591 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-logutils. 2020-01-26T15:22:56.605 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../18-python3-logutils_0.3.3-5_all.deb ... 2020-01-26T15:22:56.649 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-01-26T15:22:57.646 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-markupsafe. 2020-01-26T15:22:57.661 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../19-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-01-26T15:22:57.706 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-01-26T15:22:58.035 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-mako. 2020-01-26T15:22:58.049 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../20-python3-mako_1.0.7+ds1-1_all.deb ... 2020-01-26T15:22:58.097 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-01-26T15:22:58.459 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplegeneric. 2020-01-26T15:22:58.473 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../21-python3-simplegeneric_0.8.1-1_all.deb ... 2020-01-26T15:22:58.518 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-01-26T15:22:58.834 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-singledispatch. 2020-01-26T15:22:58.844 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../22-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-01-26T15:22:58.889 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-01-26T15:22:59.199 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webob. 2020-01-26T15:22:59.213 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../23-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-01-26T15:22:59.258 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:22:59.574 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-bs4. 2020-01-26T15:22:59.585 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../24-python3-bs4_4.6.0-1_all.deb ... 2020-01-26T15:22:59.628 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-01-26T15:22:59.964 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-waitress. 2020-01-26T15:22:59.981 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../25-python3-waitress_1.0.1-1_all.deb ... 2020-01-26T15:23:00.039 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-01-26T15:23:00.351 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tempita. 2020-01-26T15:23:00.365 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../26-python3-tempita_0.5.2-2_all.deb ... 2020-01-26T15:23:00.409 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-01-26T15:23:00.738 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-paste. 2020-01-26T15:23:00.753 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../27-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-01-26T15:23:00.796 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:23:01.170 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastedeploy. 2020-01-26T15:23:01.185 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../28-python3-pastedeploy_1.5.2-4_all.deb ... 2020-01-26T15:23:01.228 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-01-26T15:23:01.511 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webtest. 2020-01-26T15:23:01.524 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../29-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-01-26T15:23:01.569 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:23:01.955 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pecan. 2020-01-26T15:23:01.971 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../30-python3-pecan_1.2.1-2_all.deb ... 2020-01-26T15:23:02.014 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-01-26T15:23:02.736 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-werkzeug. 2020-01-26T15:23:02.750 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../31-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-01-26T15:23:02.795 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:23:03.156 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-ceph-common. 2020-01-26T15:23:03.170 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../32-python3-ceph-common_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:03.223 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:03.552 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-prettytable. 2020-01-26T15:23:03.567 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../33-python3-prettytable_0.7.2-3_all.deb ... 2020-01-26T15:23:03.610 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-01-26T15:23:03.877 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../34-python3-rbd_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:23:04.005 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rbd (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:23:04.406 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-uritemplate. 2020-01-26T15:23:04.419 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../35-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-01-26T15:23:04.472 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-01-26T15:23:04.803 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../36-ceph-fuse_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:23:04.938 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-fuse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:23:05.501 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package cephadm. 2020-01-26T15:23:05.517 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../37-cephadm_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:23:05.560 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:05.871 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-01-26T15:23:05.886 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../38-ceph-mgr-cephadm_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:05.930 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:06.258 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-repoze.lru. 2020-01-26T15:23:06.274 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../39-python3-repoze.lru_0.7-1_all.deb ... 2020-01-26T15:23:06.316 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-01-26T15:23:06.666 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-routes. 2020-01-26T15:23:06.681 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../40-python3-routes_2.4.1-1_all.deb ... 2020-01-26T15:23:06.726 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-01-26T15:23:07.045 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-01-26T15:23:07.059 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../41-ceph-mgr-dashboard_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:07.104 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-dashboard (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:07.993 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-01-26T15:23:08.016 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../42-ceph-mgr-diskprediction-cloud_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:08.051 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:08.397 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-numpy. 2020-01-26T15:23:08.410 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../43-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-01-26T15:23:08.447 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-26T15:23:09.048 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-decorator. 2020-01-26T15:23:09.062 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../44-python3-decorator_4.1.2-1_all.deb ... 2020-01-26T15:23:09.106 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-01-26T15:23:09.401 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-scipy. 2020-01-26T15:23:09.415 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../45-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-01-26T15:23:09.459 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-01-26T15:23:10.626 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-01-26T15:23:10.639 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../46-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-01-26T15:23:10.684 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-01-26T15:23:11.154 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-joblib. 2020-01-26T15:23:11.171 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../47-python3-joblib_0.11-1_all.deb ... 2020-01-26T15:23:11.212 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-joblib (0.11-1) ... 2020-01-26T15:23:11.606 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sklearn. 2020-01-26T15:23:11.623 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../48-python3-sklearn_0.19.1-3_all.deb ... 2020-01-26T15:23:11.665 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-01-26T15:23:12.299 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-01-26T15:23:12.314 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../49-ceph-mgr-diskprediction-local_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:12.359 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:13.497 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-dateutil. 2020-01-26T15:23:13.511 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../50-python3-dateutil_2.6.1-1_all.deb ... 2020-01-26T15:23:13.555 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-01-26T15:23:13.902 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-monotonic. 2020-01-26T15:23:13.918 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../51-python3-monotonic_1.1-2_all.deb ... 2020-01-26T15:23:13.962 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-01-26T15:23:14.267 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-fasteners. 2020-01-26T15:23:14.280 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../52-python3-fasteners_0.12.0-3_all.deb ... 2020-01-26T15:23:14.325 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-01-26T15:23:14.644 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-httplib2. 2020-01-26T15:23:14.659 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../53-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2020-01-26T15:23:14.699 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-26T15:23:15.057 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1. 2020-01-26T15:23:15.071 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../54-python3-pyasn1_0.4.2-3_all.deb ... 2020-01-26T15:23:15.118 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-01-26T15:23:15.472 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-01-26T15:23:15.488 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../55-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-01-26T15:23:15.530 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-26T15:23:15.873 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-rsa. 2020-01-26T15:23:15.882 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../56-python3-rsa_3.4.2-1_all.deb ... 2020-01-26T15:23:15.924 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-01-26T15:23:16.253 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-01-26T15:23:16.266 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../57-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-01-26T15:23:16.311 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-26T15:23:16.866 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-oauth2client. 2020-01-26T15:23:16.877 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../58-python3-oauth2client_4.1.2-3_all.deb ... 2020-01-26T15:23:16.918 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-01-26T15:23:17.283 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-setuptools. 2020-01-26T15:23:17.297 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../59-python3-setuptools_39.0.1-2_all.deb ... 2020-01-26T15:23:17.344 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-01-26T15:23:17.769 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-websocket. 2020-01-26T15:23:17.784 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../60-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-01-26T15:23:17.828 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-01-26T15:23:18.187 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-kubernetes. 2020-01-26T15:23:18.202 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../61-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-01-26T15:23:18.246 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-26T15:23:18.668 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-01-26T15:23:18.684 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:18.727 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:19.028 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-01-26T15:23:19.042 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../63-ceph-mgr-rook_15.0.0-9766-g084f050-1bionic_all.deb ... 2020-01-26T15:23:19.086 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking ceph-mgr-rook (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:19.413 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-attr. 2020-01-26T15:23:19.429 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../64-python-attr_17.4.0-2_all.deb ... 2020-01-26T15:23:19.480 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-attr (17.4.0-2) ... 2020-01-26T15:23:19.822 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-funcsigs. 2020-01-26T15:23:19.835 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../65-python-funcsigs_1.0.2-4_all.deb ... 2020-01-26T15:23:19.889 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-01-26T15:23:20.213 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pluggy. 2020-01-26T15:23:20.229 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../66-python-pluggy_0.6.0-1_all.deb ... 2020-01-26T15:23:20.281 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-01-26T15:23:20.585 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-py. 2020-01-26T15:23:20.598 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../67-python-py_1.5.2-1_all.deb ... 2020-01-26T15:23:20.635 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-py (1.5.2-1) ... 2020-01-26T15:23:20.965 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python-pytest. 2020-01-26T15:23:20.979 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../68-python-pytest_3.3.2-2_all.deb ... 2020-01-26T15:23:21.023 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-01-26T15:23:21.377 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-attr. 2020-01-26T15:23:21.391 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../69-python3-attr_17.4.0-2_all.deb ... 2020-01-26T15:23:21.441 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-01-26T15:23:21.766 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-cycler. 2020-01-26T15:23:21.782 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../70-python3-cycler_0.10.0-1_all.deb ... 2020-01-26T15:23:21.824 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-01-26T15:23:22.136 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-webencodings. 2020-01-26T15:23:22.152 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../71-python3-webencodings_0.5-2_all.deb ... 2020-01-26T15:23:22.194 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-01-26T15:23:22.495 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-html5lib. 2020-01-26T15:23:22.510 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../72-python3-html5lib_0.999999999-1_all.deb ... 2020-01-26T15:23:22.554 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-01-26T15:23:23.035 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-01-26T15:23:23.049 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../73-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-01-26T15:23:23.093 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:23:23.514 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyparsing. 2020-01-26T15:23:23.530 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../74-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-01-26T15:23:23.572 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-26T15:23:23.892 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tz. 2020-01-26T15:23:23.908 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../75-python3-tz_2018.3-2_all.deb ... 2020-01-26T15:23:23.950 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tz (2018.3-2) ... 2020-01-26T15:23:24.269 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-matplotlib. 2020-01-26T15:23:24.283 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../76-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-01-26T15:23:24.327 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-26T15:23:24.999 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-olefile. 2020-01-26T15:23:25.014 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../77-python3-olefile_0.45.1-1_all.deb ... 2020-01-26T15:23:25.057 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-01-26T15:23:25.369 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pastescript. 2020-01-26T15:23:25.386 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../78-python3-pastescript_2.0.2-2_all.deb ... 2020-01-26T15:23:25.427 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-01-26T15:23:25.765 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pil:amd64. 2020-01-26T15:23:25.779 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../79-python3-pil_5.1.0-1_amd64.deb ... 2020-01-26T15:23:25.820 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2020-01-26T15:23:26.182 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pluggy. 2020-01-26T15:23:26.198 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../80-python3-pluggy_0.6.0-1_all.deb ... 2020-01-26T15:23:26.265 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-01-26T15:23:26.569 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-py. 2020-01-26T15:23:26.596 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../81-python3-py_1.5.2-1_all.deb ... 2020-01-26T15:23:26.627 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-py (1.5.2-1) ... 2020-01-26T15:23:26.958 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pyinotify. 2020-01-26T15:23:26.974 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../82-python3-pyinotify_0.9.6-1_all.deb ... 2020-01-26T15:23:27.016 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-01-26T15:23:27.319 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-pytest. 2020-01-26T15:23:27.334 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../83-python3-pytest_3.3.2-2_all.deb ... 2020-01-26T15:23:27.377 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-01-26T15:23:27.706 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-simplejson. 2020-01-26T15:23:27.722 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../84-python3-simplejson_3.13.2-1_amd64.deb ... 2020-01-26T15:23:27.764 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-01-26T15:23:28.168 INFO:teuthology.orchestra.run.smithi129.stdout:Selecting previously unselected package python3-tk:amd64. 2020-01-26T15:23:28.182 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../85-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-01-26T15:23:28.226 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-26T15:23:28.553 INFO:teuthology.orchestra.run.smithi129.stdout:Preparing to unpack .../86-rbd-fuse_15.0.0-9766-g084f050-1bionic_amd64.deb ... 2020-01-26T15:23:28.686 INFO:teuthology.orchestra.run.smithi129.stdout:Unpacking rbd-fuse (15.0.0-9766-g084f050-1bionic) over (13.2.8-63-ge1c5fd9-1bionic) ... 2020-01-26T15:23:29.034 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-01-26T15:23:29.343 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-01-26T15:23:29.711 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-01-26T15:23:29.840 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-01-26T15:23:30.451 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2020-01-26T15:23:30.828 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-01-26T15:23:31.146 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webencodings (0.5-2) ... 2020-01-26T15:23:31.438 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-attr (17.4.0-2) ... 2020-01-26T15:23:31.632 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-01-26T15:23:31.758 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-py (1.5.2-1) ... 2020-01-26T15:23:32.101 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-01-26T15:23:32.436 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-01-26T15:23:32.526 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-01-26T15:23:32.813 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-01-26T15:23:33.564 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-argparse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:33.874 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-01-26T15:23:34.184 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-01-26T15:23:35.112 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-01-26T15:23:35.438 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-01-26T15:23:35.723 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-py (1.5.2-1) ... 2020-01-26T15:23:35.949 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-01-26T15:23:36.318 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-01-26T15:23:36.519 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-01-26T15:23:36.812 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-01-26T15:23:37.137 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-01-26T15:23:37.438 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-01-26T15:23:37.815 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-01-26T15:23:38.142 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-01-26T15:23:38.493 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:39.136 INFO:teuthology.orchestra.run.smithi129.stdout:Adding system user cephadm....done 2020-01-26T15:23:39.317 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-01-26T15:23:39.610 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librados2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:39.744 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-01-26T15:23:40.085 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-01-26T15:23:40.403 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:40.538 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-01-26T15:23:40.869 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:41.196 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-monotonic (1.1-2) ... 2020-01-26T15:23:41.480 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libcephfs-dev (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:41.607 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-01-26T15:23:41.975 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-01-26T15:23:42.285 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2020-01-26T15:23:42.594 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rados (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:42.737 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-01-26T15:23:43.080 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-attr (17.4.0-2) ... 2020-01-26T15:23:43.383 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-01-26T15:23:43.611 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-01-26T15:23:44.015 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-01-26T15:23:44.323 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-01-26T15:23:44.419 INFO:teuthology.orchestra.run.smithi129.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-01-26T15:23:44.680 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-01-26T15:23:44.816 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-01-26T15:23:45.077 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-01-26T15:23:45.488 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-01-26T15:23:45.823 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-tz (2018.3-2) ... 2020-01-26T15:23:46.120 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-01-26T15:23:46.421 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-01-26T15:23:46.722 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-joblib (0.11-1) ... 2020-01-26T15:23:47.070 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-routes (2.4.1-1) ... 2020-01-26T15:23:47.374 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-01-26T15:23:47.702 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-01-26T15:23:48.028 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-01-26T15:23:48.397 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-01-26T15:23:48.691 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-01-26T15:23:49.851 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-01-26T15:23:50.161 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up libradosstriper1 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:50.287 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-cephfs (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:50.580 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-01-26T15:23:50.915 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-01-26T15:23:51.041 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librgw2 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:51.167 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-01-26T15:23:51.527 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-fuse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:51.928 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up librbd1 (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:52.054 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python-pytest (3.3.2-2) ... 2020-01-26T15:23:52.314 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-01-26T15:23:52.766 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-01-26T15:23:53.067 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-01-26T15:23:53.394 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-01-26T15:23:53.703 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-01-26T15:23:54.030 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rgw (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:54.155 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-01-26T15:23:55.008 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up rbd-fuse (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:55.143 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-01-26T15:23:55.989 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-rbd (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:56.107 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-01-26T15:23:56.776 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-common (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:56.869 INFO:teuthology.orchestra.run.smithi129.stdout:Installing new version of config file /etc/bash_completion.d/rados ... 2020-01-26T15:23:57.240 INFO:teuthology.orchestra.run.smithi129.stdout:Setting system user ceph properties..usermod: no changes 2020-01-26T15:23:57.345 INFO:teuthology.orchestra.run.smithi129.stdout:..done 2020-01-26T15:23:57.362 INFO:teuthology.orchestra.run.smithi129.stdout:Fixing /var/run/ceph ownership....done 2020-01-26T15:23:57.801 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up radosgw (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:57.844 INFO:teuthology.orchestra.run.smithi129.stdout:Installing new version of config file /etc/init.d/radosgw ... 2020-01-26T15:23:58.377 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-test (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:58.504 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-base (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:58.546 INFO:teuthology.orchestra.run.smithi129.stdout:Installing new version of config file /etc/init.d/ceph ... 2020-01-26T15:23:59.047 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:59.408 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:23:59.542 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-osd (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:00.145 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-cephadm (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:00.309 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:00.436 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-rook (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:00.612 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mds (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:01.007 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mon (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:01.416 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-k8sevents (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:01.539 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph-mgr-dashboard (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:01.680 INFO:teuthology.orchestra.run.smithi129.stdout:Setting up ceph (15.0.0-9766-g084f050-1bionic) ... 2020-01-26T15:24:01.792 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2020-01-26T15:24:01.981 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-01-26T15:24:03.351 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-01-26T15:24:03.444 INFO:teuthology.orchestra.run.smithi129.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2020-01-26T15:24:03.902 INFO:teuthology.orchestra.run.smithi129.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-01-26T15:24:03.904 INFO:teuthology.orchestra.run.smithi129:> sudo lsb_release -is 2020-01-26T15:24:03.950 INFO:teuthology.orchestra.run.smithi129.stdout:Ubuntu 2020-01-26T15:24:03.955 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-01-26T15:24:03.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=084f0502288c3898c3a27b35934ea510597b049d 2020-01-26T15:24:04.148 INFO:teuthology.orchestra.run.smithi129:> dpkg-query -W -f '${Version}' ceph 2020-01-26T15:24:04.181 INFO:teuthology.orchestra.run.smithi129.stdout:15.0.0-9766-g084f050-1bionic 2020-01-26T15:24:04.181 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-9766-g084f050-1bionic 2020-01-26T15:24:04.182 INFO:teuthology.task.install:The correct ceph version 15.0.0-9766-g084f050-1bionic is installed. 2020-01-26T15:24:04.182 INFO:teuthology.run_tasks:Running task print... 2020-01-26T15:24:04.214 INFO:teuthology.task.print:**** done install.upgrade both hosts 2020-01-26T15:24:04.214 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:24:04.231 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-01-26T15:24:04.231 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:04.244 INFO:tasks.ceph.mon.a:Stopped 2020-01-26T15:24:04.245 INFO:tasks.ceph.mon.a:Restarting daemon 2020-01-26T15:24:04.245 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-01-26T15:24:04.289 INFO:tasks.ceph.mon.a:Started 2020-01-26T15:24:04.290 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-01-26T15:24:04.290 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:04.307 INFO:tasks.ceph.mon.c:Stopped 2020-01-26T15:24:04.307 INFO:tasks.ceph.mon.c:Restarting daemon 2020-01-26T15:24:04.307 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-01-26T15:24:04.353 INFO:tasks.ceph.mon.c:Started 2020-01-26T15:24:04.353 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-01-26T15:24:04.353 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:04.369 INFO:tasks.ceph.mon.b:Stopped 2020-01-26T15:24:04.369 INFO:tasks.ceph.mon.b:Restarting daemon 2020-01-26T15:24:04.369 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-01-26T15:24:04.414 INFO:tasks.ceph.mon.b:Started 2020-01-26T15:24:04.414 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-01-26T15:24:04.414 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:04.431 INFO:tasks.ceph.mgr.y:Stopped 2020-01-26T15:24:04.431 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-01-26T15:24:04.432 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-01-26T15:24:04.477 INFO:tasks.ceph.mgr.y:Started 2020-01-26T15:24:04.478 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-01-26T15:24:04.478 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:04.495 INFO:tasks.ceph.mgr.x:Stopped 2020-01-26T15:24:04.495 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-01-26T15:24:04.496 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-01-26T15:24:04.547 INFO:tasks.ceph.mgr.x:Started 2020-01-26T15:24:04.547 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:24:04.563 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:24:04.563 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:24:04.563 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set global mon_warn_on_msgr2_not_enabled false' 2020-01-26T15:24:04.585 INFO:tasks.ceph.mgr.y.smithi129.stderr:2020-01-26T15:24:04.582+0000 7f48cf05f700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x55ec90678000 0x55ec90680000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:04.616 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:04.614+0000 7f7878bbe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x55c64622e480 0x55c646236000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:04.616 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:04.614+0000 7f7879bc0700 -1 --2- 172.21.15.129:0/2321624508 >> v2:172.21.15.129:6791/0 conn(0x55c64622e900 0x55c646236580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:04.637 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:04.634+0000 7f7878bbe700 -1 --2- 172.21.15.129:0/16899 >> v2:172.21.15.129:6791/0 conn(0x55c64622e900 0x55c646236b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:04.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 Processor -- start 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 -- start start 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 0x7f976c0f0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c026920 con 0x7f976c0264f0 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0282f0 con 0x7f976c027410 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.858+0000 7f977980b700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f976c025750 con 0x7f976c025d20 2020-01-26T15:24:04.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977aa6d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 0x7f976c0f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977900a700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f976c027410 0x7f976c0e1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44658/0 (socket says 172.21.15.129:44658) 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977900a700 1 -- 172.21.15.129:0/2061062721 learned_addr learned my addr 172.21.15.129:0/2061062721 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f9778809700 1 --1- 172.21.15.129:0/2061062721 >> v1:172.21.15.129:6790/0 conn(0x7f976c0264f0 0x7f976c0ecb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47044/0 (socket says 172.21.15.129:47044) 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977aa6d700 1 --2- 172.21.15.129:0/2061062721 >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 0x7f976c0f0380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904474989 0 0) 0x7f97640010d0 con 0x7f976c0264f0 2020-01-26T15:24:04.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003230 con 0x7f976c0264f0 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228302147 0 0) 0x7f976c0282f0 con 0x7f976c027410 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97640010d0 con 0x7f976c027410 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2397260580 0 0) 0x7f9760003230 con 0x7f976c0264f0 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 msgr2=0x7f976c0f0380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 --2- 172.21.15.129:0/2061062721 >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 0x7f976c0f0380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 >> v1:172.21.15.129:6791/0 conn(0x7f976c027410 legacy=0x7f976c0e1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:04.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c026150 con 0x7f976c0264f0 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f9764001910 con 0x7f976c0264f0 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9764001ca0 con 0x7f976c0264f0 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f976bfff700 1 -- 172.21.15.129:0/2061062721 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f97640046f0 con 0x7f976c0264f0 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- 172.21.15.129:0/2061062721 >> v1:172.21.15.129:6790/0 conn(0x7f976c0264f0 legacy=0x7f976c0ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- 172.21.15.129:0/2061062721 shutdown_connections 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 --2- 172.21.15.129:0/2061062721 >> v2:172.21.15.129:6790/0 conn(0x7f976c025d20 0x7f976c0f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- 172.21.15.129:0/2061062721 >> 172.21.15.129:0/2061062721 conn(0x7f976c0389a0 msgr2=0x7f976c038dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:04.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- 172.21.15.129:0/2061062721 shutdown_connections 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- 172.21.15.129:0/2061062721 wait complete. 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 Processor -- start 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.862+0000 7f977980b700 1 -- start start 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 0x7f976c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0e32a0 con 0x7f976c021280 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c0e2b50 con 0x7f976c0c2b10 2020-01-26T15:24:04.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f976c0e81b0 con 0x7f976c0c8f60 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977900a700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f976c0c2b10 0x7f976c021800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44666/0 (socket says 172.21.15.129:44666) 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977900a700 1 -- 172.21.15.129:0/2729468534 learned_addr learned my addr 172.21.15.129:0/2729468534 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977aa6d700 -1 --2- 172.21.15.129:0/2729468534 >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 0x7f976c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977aa6d700 1 --2- 172.21.15.129:0/2729468534 >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 0x7f976c0cb3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956656974 0 0) 0x7f976c0e2b50 con 0x7f976c0c2b10 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9754003230 con 0x7f976c0c2b10 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629280748 0 0) 0x7f976c0e32a0 con 0x7f976c021280 2020-01-26T15:24:04.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976c0e2b50 con 0x7f976c021280 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 338449645 0 0) 0x7f976c0e2b50 con 0x7f976c021280 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f976c0e32a0 con 0x7f976c021280 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1046901865 0 0) 0x7f9754003230 con 0x7f976c0c2b10 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f976c0e2b50 con 0x7f976c0c2b10 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f9764001650 con 0x7f976c021280 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f97740434a0 con 0x7f976c0c2b10 2020-01-26T15:24:04.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 821620268 0 0) 0x7f976c0e32a0 con 0x7f976c021280 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 msgr2=0x7f976c0cb3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 --2- 172.21.15.129:0/2729468534 >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 0x7f976c0cb3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 >> v1:172.21.15.129:6791/0 conn(0x7f976c0c2b10 legacy=0x7f976c021800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0e7990 con 0x7f976c021280 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c0e4690 con 0x7f976c021280 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c0cb8f0 con 0x7f976c021280 2020-01-26T15:24:04.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f97640019c0 con 0x7f976c021280 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f9764004df0 con 0x7f976c021280 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f9764005620 con 0x7f976c021280 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f976c026920 con 0x7f976c021280 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.866+0000 7f977900a700 1 -- 172.21.15.129:0/2729468534 >> v1:172.21.15.129:6800/11038 conn(0x7f9754005f80 legacy=0x7f9754008410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.870+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c003360 con 0x7f976c021280 2020-01-26T15:24:04.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.870+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f9764007a20 con 0x7f976c021280 2020-01-26T15:24:04.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.946+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "config set", "who": "global", "name": "mon_warn_on_msgr2_not_enabled", "value": "false"} v 0) v1 -- 0x7f974c002240 con 0x7f976c021280 2020-01-26T15:24:04.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.954+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 10 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f9764004ff0 con 0x7f976c021280 2020-01-26T15:24:04.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.954+0000 7f9769ffb700 1 -- 172.21.15.129:0/2729468534 <== mon.0 v1:172.21.15.129:6789/0 11 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_warn_on_msgr2_not_enabled", "value": "false"}]=0 v2) v1 ==== 134+0+0 (unknown 2256562639 0 0) 0x7f9764005350 con 0x7f976c021280 2020-01-26T15:24:04.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 >> v1:172.21.15.129:6800/11038 conn(0x7f9754005f80 legacy=0x7f9754008410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 >> v1:172.21.15.129:6789/0 conn(0x7f976c021280 legacy=0x7f976c0245d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 shutdown_connections 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 --2- 172.21.15.129:0/2729468534 >> v2:172.21.15.129:6790/0 conn(0x7f976c0c8f60 0x7f976c0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 >> 172.21.15.129:0/2729468534 conn(0x7f976c025d20 msgr2=0x7f976c034860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 shutdown_connections 2020-01-26T15:24:04.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:04.958+0000 7f977980b700 1 -- 172.21.15.129:0/2729468534 wait complete. 2020-01-26T15:24:04.973 INFO:teuthology.run_tasks:Running task ceph.healthy... 2020-01-26T15:24:04.988 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:24:04.988 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:24:04.988 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:24:05.128 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 Processor -- start 2020-01-26T15:24:05.128 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 -- start start 2020-01-26T15:24:05.128 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 0x7ffa3c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c05ea20 con 0x7ffa3c05edd0 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c098000 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3bfff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c05e050 con 0x7ffa3c0a6870 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3b7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ffa3c05edd0 0x7ffa3c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47078/0 (socket says 172.21.15.129:47078) 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa3b7fe700 1 -- 172.21.15.129:0/492286668 learned_addr learned my addr 172.21.15.129:0/492286668 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa4139f700 -1 --2- 172.21.15.129:0/492286668 >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 0x7ffa3c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.118+0000 7ffa4139f700 1 --2- 172.21.15.129:0/492286668 >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 0x7ffa3c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298129706 0 0) 0x7ffa3c098000 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa28003230 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812496608 0 0) 0x7ffa3c05ea20 con 0x7ffa3c05edd0 2020-01-26T15:24:05.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c098000 con 0x7ffa3c05edd0 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3773363792 0 0) 0x7ffa28003230 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 msgr2=0x7ffa3c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 --2- 172.21.15.129:0/492286668 >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 0x7ffa3c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 >> v1:172.21.15.129:6790/0 conn(0x7ffa3c05edd0 legacy=0x7ffa3c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0a6ca0 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ffa240016e0 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ffa24001a50 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3a7fc700 1 -- 172.21.15.129:0/492286668 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ffa24001ec0 con 0x7ffa3c05e5f0 2020-01-26T15:24:05.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- 172.21.15.129:0/492286668 >> v1:172.21.15.129:6791/0 conn(0x7ffa3c05e5f0 legacy=0x7ffa3c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- 172.21.15.129:0/492286668 shutdown_connections 2020-01-26T15:24:05.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 --2- 172.21.15.129:0/492286668 >> v2:172.21.15.129:6791/0 conn(0x7ffa3c0a6870 0x7ffa3c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- 172.21.15.129:0/492286668 >> 172.21.15.129:0/492286668 conn(0x7ffa3c098e70 msgr2=0x7ffa3c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- 172.21.15.129:0/492286668 shutdown_connections 2020-01-26T15:24:05.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- 172.21.15.129:0/492286668 wait complete. 2020-01-26T15:24:05.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 Processor -- start 2020-01-26T15:24:05.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.122+0000 7ffa3bfff700 1 -- start start 2020-01-26T15:24:05.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 0x7ffa3c138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c077870 con 0x7ffa3c075c70 2020-01-26T15:24:05.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c076180 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c09ff20 con 0x7ffa3c12a2c0 2020-01-26T15:24:05.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3affd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ffa3c0a0a50 0x7ffa3c129ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47086/0 (socket says 172.21.15.129:47086) 2020-01-26T15:24:05.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3affd700 1 -- 172.21.15.129:0/1354748725 learned_addr learned my addr 172.21.15.129:0/1354748725 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa4139f700 -1 --2- 172.21.15.129:0/1354748725 >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 0x7ffa3c138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa4139f700 1 --2- 172.21.15.129:0/1354748725 >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 0x7ffa3c138aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182548629 0 0) 0x7ffa3c076180 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa20003230 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840336114 0 0) 0x7ffa3c077870 con 0x7ffa3c075c70 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c076180 con 0x7ffa3c075c70 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1126395587 0 0) 0x7ffa20003230 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa3c077870 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ffa24001bf0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2149570705 0 0) 0x7ffa3c076180 con 0x7ffa3c075c70 2020-01-26T15:24:05.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa20003230 con 0x7ffa3c075c70 2020-01-26T15:24:05.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ffa2c001760 con 0x7ffa3c075c70 2020-01-26T15:24:05.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1594329509 0 0) 0x7ffa3c077870 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 msgr2=0x7ffa3c138aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 --2- 172.21.15.129:0/1354748725 >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 0x7ffa3c138aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 >> v1:172.21.15.129:6789/0 conn(0x7ffa3c075c70 legacy=0x7ffa3c076c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c078dc0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c0a4690 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c12a6f0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ffa24002250 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ffa240025c0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7ffa240055d0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3b7fe700 1 -- 172.21.15.129:0/1354748725 >> v1:172.21.15.129:6800/11038 conn(0x7ffa20005e40 legacy=0x7ffa20008280 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:05.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7ffa240064d0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.144 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.126+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c056600 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.144 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.134+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7ffa24004fa0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffa3c0a7d70 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa33fff700 1 -- 172.21.15.129:0/1354748725 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+2958 (unknown 3797009233 0 2626289772) 0x7ffa240051c0 con 0x7ffa3c0a0a50 2020-01-26T15:24:05.232 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 >> v1:172.21.15.129:6800/11038 conn(0x7ffa20005e40 legacy=0x7ffa20008280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 >> v1:172.21.15.129:6790/0 conn(0x7ffa3c0a0a50 legacy=0x7ffa3c129ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 shutdown_connections 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 --2- 172.21.15.129:0/1354748725 >> v2:172.21.15.129:6790/0 conn(0x7ffa3c12a2c0 0x7ffa3c138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 >> 172.21.15.129:0/1354748725 conn(0x7ffa3c0a5520 msgr2=0x7ffa3c07c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 shutdown_connections 2020-01-26T15:24:05.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.230+0000 7ffa3bfff700 1 -- 172.21.15.129:0/1354748725 wait complete. 2020-01-26T15:24:05.250 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6800","nonce":11038}]},"active_addr":"172.21.15.129:6800/11038","active_change":"0.000000","active_mgr_features":0,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":0,"available_modules":[{"name":"balancer","can_run":true,"error_string":"","module_options":{}},{"name":"crash","can_run":true,"error_string":"","module_options":{}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{}},{"name":"hello","can_run":true,"error_string":"","module_options":{}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{}},{"name":"smart","can_run":true,"error_string":"","module_options":{}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{}}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"balancer","can_run":true,"error_string":"","module_options":{}},{"name":"crash","can_run":true,"error_string":"","module_options":{}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{}},{"name":"hello","can_run":true,"error_string":"","module_options":{}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{}},{"name":"smart","can_run":true,"error_string":"","module_options":{}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2020-01-26T15:24:05.250 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:24:05.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:24:05.251 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.350+0000 7f7435c7d700 1 Processor -- start 2020-01-26T15:24:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.350+0000 7f7435c7d700 1 -- start start 2020-01-26T15:24:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 0x7f74300a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 0x7f743014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300a5b80 con 0x7f74300a4b50 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f74300a43f0 con 0x7f743005f250 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f74300a4f80 con 0x7f74300a5750 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742f7fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f74300a4b50 0x7f743005ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44710/0 (socket says 172.21.15.129:44710) 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742ffff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 0x7f74300a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742f7fe700 1 -- 172.21.15.129:0/25250240 learned_addr learned my addr 172.21.15.129:0/25250240 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742ffff700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 0x7f74300a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7434a1b700 -1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 0x7f743014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7434a1b700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 0x7f743014bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070648017 0 0) 0x7f74300a5b80 con 0x7f74300a4b50 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c003230 con 0x7f74300a4b50 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 637570774 0 0) 0x7f741c003230 con 0x7f74300a4b50 2020-01-26T15:24:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 msgr2=0x7f74300a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 0x7f74300a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 msgr2=0x7f743014bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 0x7f743014bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430080440 con 0x7f74300a4b50 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f74180016e0 con 0x7f74300a4b50 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7418001b10 con 0x7f74300a4b50 2020-01-26T15:24:05.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f742effd700 1 -- 172.21.15.129:0/25250240 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f7418004730 con 0x7f74300a4b50 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- 172.21.15.129:0/25250240 >> v1:172.21.15.129:6791/0 conn(0x7f74300a4b50 legacy=0x7f743005ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- 172.21.15.129:0/25250240 shutdown_connections 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6790/0 conn(0x7f743005f250 0x7f743014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 --2- 172.21.15.129:0/25250240 >> v2:172.21.15.129:6791/0 conn(0x7f74300a5750 0x7f74300a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- 172.21.15.129:0/25250240 >> 172.21.15.129:0/25250240 conn(0x7f743005e050 msgr2=0x7f7430098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- 172.21.15.129:0/25250240 shutdown_connections 2020-01-26T15:24:05.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.354+0000 7f7435c7d700 1 -- 172.21.15.129:0/25250240 wait complete. 2020-01-26T15:24:05.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 Processor -- start 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- start start 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 0x7f74300a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300970d0 con 0x7f74300625b0 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7430095670 con 0x7f743007c9e0 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f74300a2560 con 0x7f743011ec60 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742ffff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f74300625b0 0x7f74300a1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38798/0 (socket says 172.21.15.129:38798) 2020-01-26T15:24:05.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742ffff700 1 -- 172.21.15.129:0/2310750423 learned_addr learned my addr 172.21.15.129:0/2310750423 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742f7fe700 -1 --2- 172.21.15.129:0/2310750423 >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 0x7f74300a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742f7fe700 1 --2- 172.21.15.129:0/2310750423 >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 0x7f74300a0f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791337988 0 0) 0x7f74300970d0 con 0x7f74300625b0 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7414003230 con 0x7f74300625b0 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695822374 0 0) 0x7f7430095670 con 0x7f743007c9e0 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74300970d0 con 0x7f743007c9e0 2020-01-26T15:24:05.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 912727378 0 0) 0x7f7414003230 con 0x7f74300625b0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7430095670 con 0x7f74300625b0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f7420002a90 con 0x7f74300625b0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1896889178 0 0) 0x7f74300970d0 con 0x7f743007c9e0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7414003230 con 0x7f743007c9e0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f74280015f0 con 0x7f743007c9e0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2607528543 0 0) 0x7f7430095670 con 0x7f74300625b0 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 msgr2=0x7f74300a0f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 --2- 172.21.15.129:0/2310750423 >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 0x7f74300a0f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 >> v1:172.21.15.129:6790/0 conn(0x7f743007c9e0 legacy=0x7f743007ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743007d610 con 0x7f74300625b0 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7430139560 con 0x7f74300625b0 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7430139ab0 con 0x7f74300625b0 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f7420001210 con 0x7f74300625b0 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f74200015f0 con 0x7f74300625b0 2020-01-26T15:24:05.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f7420001ee0 con 0x7f74300625b0 2020-01-26T15:24:05.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f7420007bf0 con 0x7f74300625b0 2020-01-26T15:24:05.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f742f7fe700 1 -- 172.21.15.129:0/2310750423 >> v1:172.21.15.129:6800/11038 conn(0x7f7414005f20 legacy=0x7f7414008360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:05.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.358+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7430056600 con 0x7f74300625b0 2020-01-26T15:24:05.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.362+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f74200017f0 con 0x7f74300625b0 2020-01-26T15:24:05.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.430+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f743005cc60 con 0x7f74300625b0 2020-01-26T15:24:05.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f742cff9700 1 -- 172.21.15.129:0/2310750423 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8886 (unknown 1054498076 0 1021987560) 0x7f7420001bb0 con 0x7f74300625b0 2020-01-26T15:24:05.437 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:05.437 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:21:52.217088+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":11408}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":11408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":11408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":11408}]},"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":11406}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":11406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":11406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":11406}]},"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":11410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":11410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":11410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":11410}]},"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":11407}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":11407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":11407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":11407}]},"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:05.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 >> v1:172.21.15.129:6800/11038 conn(0x7f7414005f20 legacy=0x7f7414008360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 >> v1:172.21.15.129:6789/0 conn(0x7f74300625b0 legacy=0x7f74300a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 shutdown_connections 2020-01-26T15:24:05.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 --2- 172.21.15.129:0/2310750423 >> v2:172.21.15.129:6791/0 conn(0x7f743011ec60 0x7f74300a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 >> 172.21.15.129:0/2310750423 conn(0x7f74300979c0 msgr2=0x7f743007f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 shutdown_connections 2020-01-26T15:24:05.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.434+0000 7f7435c7d700 1 -- 172.21.15.129:0/2310750423 wait complete. 2020-01-26T15:24:05.449 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:24:05.450 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:05.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 Processor -- start 2020-01-26T15:24:05.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- start start 2020-01-26T15:24:05.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 0x7f39640a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 0x7f396405ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640a5b80 con 0x7f396405efa0 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f39640a43f0 con 0x7f39640a4b50 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f39640a4f80 con 0x7f39640a5750 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f3963fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 0x7f396405ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f3968cf0700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 0x7f39640a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f3963fff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 0x7f396405ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f3968cf0700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 0x7f39640a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39694f1700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f396405efa0 0x7f396414ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47114/0 (socket says 172.21.15.129:47114) 2020-01-26T15:24:05.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39694f1700 1 -- 172.21.15.129:0/2748180761 learned_addr learned my addr 172.21.15.129:0/2748180761 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975229782 0 0) 0x7f39640a5b80 con 0x7f396405efa0 2020-01-26T15:24:05.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3950003230 con 0x7f396405efa0 2020-01-26T15:24:05.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1883275184 0 0) 0x7f3950003230 con 0x7f396405efa0 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 msgr2=0x7f39640a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 --2- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 0x7f39640a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 msgr2=0x7f396405ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 --2- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 0x7f396405ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964080440 con 0x7f396405efa0 2020-01-26T15:24:05.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f395c001a60 con 0x7f396405efa0 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f395c001e90 con 0x7f396405efa0 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f39637fe700 1 -- 172.21.15.129:0/2748180761 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f395c004ab0 con 0x7f396405efa0 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- 172.21.15.129:0/2748180761 >> v1:172.21.15.129:6790/0 conn(0x7f396405efa0 legacy=0x7f396414ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- 172.21.15.129:0/2748180761 shutdown_connections 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 --2- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6791/0 conn(0x7f39640a5750 0x7f39640a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 --2- 172.21.15.129:0/2748180761 >> v2:172.21.15.129:6790/0 conn(0x7f39640a4b50 0x7f396405ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- 172.21.15.129:0/2748180761 >> 172.21.15.129:0/2748180761 conn(0x7f396405e050 msgr2=0x7f3964098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- 172.21.15.129:0/2748180761 shutdown_connections 2020-01-26T15:24:05.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.558+0000 7f396a753700 1 -- 172.21.15.129:0/2748180761 wait complete. 2020-01-26T15:24:05.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 Processor -- start 2020-01-26T15:24:05.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- start start 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 0x7f3964140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396407ce30 con 0x7f3964137850 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396411e820 con 0x7f3964120650 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3964096400 con 0x7f396413dc10 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39694f1700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 0x7f3964140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39694f1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 0x7f3964140050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f3968cf0700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f3964120650 0x7f396407d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44732/0 (socket says 172.21.15.129:44732) 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f3968cf0700 1 -- 172.21.15.129:0/4040938039 learned_addr learned my addr 172.21.15.129:0/4040938039 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264677410 0 0) 0x7f396411e820 con 0x7f3964120650 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3948003230 con 0x7f3964120650 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673667414 0 0) 0x7f396407ce30 con 0x7f3964137850 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f396411e820 con 0x7f3964137850 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1795837975 0 0) 0x7f396411e820 con 0x7f3964137850 2020-01-26T15:24:05.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f396407ce30 con 0x7f3964137850 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 402537971 0 0) 0x7f3948003230 con 0x7f3964120650 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f396411e820 con 0x7f3964120650 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f394c001670 con 0x7f3964137850 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3954002690 con 0x7f3964120650 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1555172339 0 0) 0x7f396411e820 con 0x7f3964120650 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 msgr2=0x7f3964140050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 --2- 172.21.15.129:0/4040938039 >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 0x7f3964140050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 >> v1:172.21.15.129:6790/0 conn(0x7f3964137850 legacy=0x7f3964137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964138480 con 0x7f3964120650 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39641405a0 con 0x7f3964120650 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3964140aa0 con 0x7f3964120650 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3954000e90 con 0x7f3964120650 2020-01-26T15:24:05.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3954001330 con 0x7f3964120650 2020-01-26T15:24:05.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f3954005780 con 0x7f3964120650 2020-01-26T15:24:05.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f3963fff700 1 -- 172.21.15.129:0/4040938039 >> v1:172.21.15.129:6800/11038 conn(0x7f3948005f20 legacy=0x7f3948008390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:05.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f3954006600 con 0x7f3964120650 2020-01-26T15:24:05.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.562+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c003360 con 0x7f3964120650 2020-01-26T15:24:05.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.566+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f39540015b0 con 0x7f3964120650 2020-01-26T15:24:05.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f393c0021f0 con 0x7f3964120650 2020-01-26T15:24:05.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f39617fa700 1 -- 172.21.15.129:0/4040938039 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8886 (unknown 1054498076 0 1021987560) 0x7f39540018d0 con 0x7f3964120650 2020-01-26T15:24:05.649 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:05.650 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":16,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:21:52.217088+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":11408}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":11408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":11408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":11408}]},"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":11406}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":11406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":11406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":11406}]},"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":11410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":11410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":11410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":11410}]},"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":11407}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":11407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":11407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":11407}]},"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 >> v1:172.21.15.129:6800/11038 conn(0x7f3948005f20 legacy=0x7f3948008390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 >> v1:172.21.15.129:6791/0 conn(0x7f3964120650 legacy=0x7f396407d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 shutdown_connections 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 --2- 172.21.15.129:0/4040938039 >> v2:172.21.15.129:6790/0 conn(0x7f396413dc10 0x7f3964140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 >> 172.21.15.129:0/4040938039 conn(0x7f39640954c0 msgr2=0x7f396407e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 shutdown_connections 2020-01-26T15:24:05.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.646+0000 7f396a753700 1 -- 172.21.15.129:0/4040938039 wait complete. 2020-01-26T15:24:05.665 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:24:05.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 Processor -- start 2020-01-26T15:24:05.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 -- start start 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 0x7fbf44149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440a5b80 con 0x7fbf441495c0 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf44080440 con 0x7fbf440a5750 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.758+0000 7fbf48a8c700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440a43f0 con 0x7fbf44146c30 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf4359e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbf441495c0 0x7fbf4414ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47132/0 (socket says 172.21.15.129:47132) 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf4359e700 1 -- 172.21.15.129:0/751528275 learned_addr learned my addr 172.21.15.129:0/751528275 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf4259c700 -1 --2- 172.21.15.129:0/751528275 >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 0x7fbf44149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf4259c700 1 --2- 172.21.15.129:0/751528275 >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 0x7fbf44149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100276810 0 0) 0x7fbf440a5b80 con 0x7fbf441495c0 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf2c003230 con 0x7fbf441495c0 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657440248 0 0) 0x7fbf44080440 con 0x7fbf440a5750 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf440a5b80 con 0x7fbf440a5750 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 273201818 0 0) 0x7fbf2c003230 con 0x7fbf441495c0 2020-01-26T15:24:05.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 msgr2=0x7fbf44149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 --2- 172.21.15.129:0/751528275 >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 0x7fbf44149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 >> v1:172.21.15.129:6791/0 conn(0x7fbf440a5750 legacy=0x7fbf440a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440a4e00 con 0x7fbf441495c0 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbf3c001a60 con 0x7fbf441495c0 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fbf3c001dd0 con 0x7fbf441495c0 2020-01-26T15:24:05.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf41d9b700 1 -- 172.21.15.129:0/751528275 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbf3c004930 con 0x7fbf441495c0 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- 172.21.15.129:0/751528275 >> v1:172.21.15.129:6790/0 conn(0x7fbf441495c0 legacy=0x7fbf4414ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- 172.21.15.129:0/751528275 shutdown_connections 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 --2- 172.21.15.129:0/751528275 >> v2:172.21.15.129:6791/0 conn(0x7fbf44146c30 0x7fbf44149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- 172.21.15.129:0/751528275 >> 172.21.15.129:0/751528275 conn(0x7fbf4405e050 msgr2=0x7fbf44098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- 172.21.15.129:0/751528275 shutdown_connections 2020-01-26T15:24:05.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- 172.21.15.129:0/751528275 wait complete. 2020-01-26T15:24:05.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 Processor -- start 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.762+0000 7fbf48a8c700 1 -- start start 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbf44063640 0x7fbf44062d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbf441314a0 0x7fbf44096690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf44096be0 con 0x7fbf44131070 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbf44121850 con 0x7fbf44063640 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbf44131a40 con 0x7fbf441314a0 2020-01-26T15:24:05.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf42d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbf44063640 0x7fbf44062d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf42d9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbf44063640 0x7fbf44062d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf4259c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbf44131070 0x7fbf44095e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44754/0 (socket says 172.21.15.129:44754) 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf4359e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbf441314a0 0x7fbf44096690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf4259c700 1 -- 172.21.15.129:0/2224734443 learned_addr learned my addr 172.21.15.129:0/2224734443 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf4359e700 1 --2- 172.21.15.129:0/2224734443 >> v2:172.21.15.129:6791/0 conn(0x7fbf441314a0 0x7fbf44096690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884016727 0 0) 0x7fbf44096be0 con 0x7fbf44131070 2020-01-26T15:24:05.775 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003230 con 0x7fbf44131070 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3354893187 0 0) 0x7fbf28003230 con 0x7fbf44131070 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf44096be0 con 0x7fbf44131070 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbf380026f0 con 0x7fbf44131070 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 742432804 0 0) 0x7fbf44096be0 con 0x7fbf44131070 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 >> v2:172.21.15.129:6791/0 conn(0x7fbf441314a0 msgr2=0x7fbf44096690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 --2- 172.21.15.129:0/2224734443 >> v2:172.21.15.129:6791/0 conn(0x7fbf441314a0 0x7fbf44096690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 >> v2:172.21.15.129:6790/0 conn(0x7fbf44063640 msgr2=0x7fbf44062d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.777 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 --2- 172.21.15.129:0/2224734443 >> v2:172.21.15.129:6790/0 conn(0x7fbf44063640 0x7fbf44062d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.777 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44063280 con 0x7fbf44131070 2020-01-26T15:24:05.777 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44065e70 con 0x7fbf44131070 2020-01-26T15:24:05.777 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf44138790 con 0x7fbf44131070 2020-01-26T15:24:05.777 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fbf38000f10 con 0x7fbf44131070 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbf380012f0 con 0x7fbf44131070 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7fbf38005780 con 0x7fbf44131070 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7fbf38007a60 con 0x7fbf44131070 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf42d9d700 1 -- 172.21.15.129:0/2224734443 >> v1:172.21.15.129:6800/11038 conn(0x7fbf28005120 legacy=0x7fbf28007f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.766+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6809/11408 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf44056600 con 0x7fbf44055380 2020-01-26T15:24:05.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.770+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== osd.0 v1:172.21.15.129:6809/11408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7fbf44056600 con 0x7fbf44055380 2020-01-26T15:24:05.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 --> v1:172.21.15.129:6809/11408 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf44055fb0 con 0x7fbf44055380 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf337fe700 1 -- 172.21.15.129:0/2224734443 <== osd.0 v1:172.21.15.129:6809/11408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4185362170) 0x7fbf44055fb0 con 0x7fbf44055380 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 >> v1:172.21.15.129:6809/11408 conn(0x7fbf44055380 legacy=0x7fbf440557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 >> v1:172.21.15.129:6800/11038 conn(0x7fbf28005120 legacy=0x7fbf28007f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 >> v1:172.21.15.129:6791/0 conn(0x7fbf44131070 legacy=0x7fbf44095e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf4359e700 1 -- 172.21.15.129:0/2224734443 reap_dead start 2020-01-26T15:24:05.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 shutdown_connections 2020-01-26T15:24:05.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 >> 172.21.15.129:0/2224734443 conn(0x7fbf440954c0 msgr2=0x7fbf44123ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 shutdown_connections 2020-01-26T15:24:05.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.778+0000 7fbf48a8c700 1 -- 172.21.15.129:0/2224734443 wait complete. 2020-01-26T15:24:05.782 INFO:teuthology.orchestra.run.smithi129.stdout:38654705698 2020-01-26T15:24:05.792 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:24:05.898 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 Processor -- start 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- start start 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 0x7fc83c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c098000 con 0x7fc83c149040 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c05e050 con 0x7fc83c0a6870 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0a6ca0 con 0x7fc83c05edd0 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83affd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fc83c0a6870 0x7fc83c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44776/0 (socket says 172.21.15.129:44776) 2020-01-26T15:24:05.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83affd700 1 -- 172.21.15.129:0/2035553362 learned_addr learned my addr 172.21.15.129:0/2035553362 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83b7fe700 -1 --2- 172.21.15.129:0/2035553362 >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 0x7fc83c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83b7fe700 1 --2- 172.21.15.129:0/2035553362 >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 0x7fc83c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847863131 0 0) 0x7fc83c098000 con 0x7fc83c149040 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc824003230 con 0x7fc83c149040 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560302651 0 0) 0x7fc83c05e050 con 0x7fc83c0a6870 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c098000 con 0x7fc83c0a6870 2020-01-26T15:24:05.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1603192119 0 0) 0x7fc824003230 con 0x7fc83c149040 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 msgr2=0x7fc83c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 --2- 172.21.15.129:0/2035553362 >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 0x7fc83c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 >> v1:172.21.15.129:6791/0 conn(0x7fc83c0a6870 legacy=0x7fc83c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c14ecb0 con 0x7fc83c149040 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc8300016e0 con 0x7fc83c149040 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc8300019d0 con 0x7fc83c149040 2020-01-26T15:24:05.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83a7fc700 1 -- 172.21.15.129:0/2035553362 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc830001ec0 con 0x7fc83c149040 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- 172.21.15.129:0/2035553362 >> v1:172.21.15.129:6789/0 conn(0x7fc83c149040 legacy=0x7fc83c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- 172.21.15.129:0/2035553362 shutdown_connections 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 --2- 172.21.15.129:0/2035553362 >> v2:172.21.15.129:6790/0 conn(0x7fc83c05edd0 0x7fc83c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- 172.21.15.129:0/2035553362 >> 172.21.15.129:0/2035553362 conn(0x7fc83c098e70 msgr2=0x7fc83c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- 172.21.15.129:0/2035553362 shutdown_connections 2020-01-26T15:24:05.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- 172.21.15.129:0/2035553362 wait complete. 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 Processor -- start 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.894+0000 7fc83bfff700 1 -- start start 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc83c12aea0 0x7fc83c139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c1317f0 con 0x7fc83c11ffe0 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c121c00 con 0x7fc83c121230 2020-01-26T15:24:05.906 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c131ae0 con 0x7fc83c12aea0 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83affd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fc83c11ffe0 0x7fc83c12a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47166/0 (socket says 172.21.15.129:47166) 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83affd700 1 -- 172.21.15.129:0/3495103859 learned_addr learned my addr 172.21.15.129:0/3495103859 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc841322700 -1 --2- 172.21.15.129:0/3495103859 >> v2:172.21.15.129:6791/0 conn(0x7fc83c12aea0 0x7fc83c139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc841322700 1 --2- 172.21.15.129:0/3495103859 >> v2:172.21.15.129:6791/0 conn(0x7fc83c12aea0 0x7fc83c139680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317425155 0 0) 0x7fc83c121c00 con 0x7fc83c121230 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c003230 con 0x7fc83c121230 2020-01-26T15:24:05.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30233764 0 0) 0x7fc83c1317f0 con 0x7fc83c11ffe0 2020-01-26T15:24:05.908 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c121c00 con 0x7fc83c11ffe0 2020-01-26T15:24:05.908 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 166992431 0 0) 0x7fc81c003230 con 0x7fc83c121230 2020-01-26T15:24:05.908 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc83c1317f0 con 0x7fc83c121230 2020-01-26T15:24:05.908 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc82c0026c0 con 0x7fc83c121230 2020-01-26T15:24:05.908 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4220787482 0 0) 0x7fc83c121c00 con 0x7fc83c11ffe0 2020-01-26T15:24:05.909 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc81c003230 con 0x7fc83c11ffe0 2020-01-26T15:24:05.909 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc834001b60 con 0x7fc83c11ffe0 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 375148147 0 0) 0x7fc83c1317f0 con 0x7fc83c121230 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 >> v2:172.21.15.129:6791/0 conn(0x7fc83c12aea0 msgr2=0x7fc83c139680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 --2- 172.21.15.129:0/3495103859 >> v2:172.21.15.129:6791/0 conn(0x7fc83c12aea0 0x7fc83c139680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 >> v1:172.21.15.129:6790/0 conn(0x7fc83c11ffe0 legacy=0x7fc83c12a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c121740 con 0x7fc83c121230 2020-01-26T15:24:05.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0a1340 con 0x7fc83c121230 2020-01-26T15:24:05.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c12b470 con 0x7fc83c121230 2020-01-26T15:24:05.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc82c000fa0 con 0x7fc83c121230 2020-01-26T15:24:05.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc82c001350 con 0x7fc83c121230 2020-01-26T15:24:05.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7fc82c001c40 con 0x7fc83c121230 2020-01-26T15:24:05.912 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7fc82c0077f0 con 0x7fc83c121230 2020-01-26T15:24:05.912 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83affd700 1 -- 172.21.15.129:0/3495103859 >> v1:172.21.15.129:6800/11038 conn(0x7fc81c005f20 legacy=0x7fc81c008360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:05.912 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6801/11406 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc814005480 con 0x7fc8140015e0 2020-01-26T15:24:05.912 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.898+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== osd.1 v1:172.21.15.129:6801/11406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7fc814005480 con 0x7fc8140015e0 2020-01-26T15:24:05.913 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 --> v1:172.21.15.129:6801/11406 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc814006df0 con 0x7fc8140015e0 2020-01-26T15:24:05.913 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc823fff700 1 -- 172.21.15.129:0/3495103859 <== osd.1 v1:172.21.15.129:6801/11406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4185362170) 0x7fc814006df0 con 0x7fc8140015e0 2020-01-26T15:24:05.914 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 >> v1:172.21.15.129:6801/11406 conn(0x7fc8140015e0 legacy=0x7fc814003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 >> v1:172.21.15.129:6800/11038 conn(0x7fc81c005f20 legacy=0x7fc81c008360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 >> v1:172.21.15.129:6791/0 conn(0x7fc83c121230 legacy=0x7fc83c130ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc841322700 1 -- 172.21.15.129:0/3495103859 reap_dead start 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 shutdown_connections 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 >> 172.21.15.129:0/3495103859 conn(0x7fc83c07ded0 msgr2=0x7fc83c07ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:05.915 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 shutdown_connections 2020-01-26T15:24:05.916 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:05.906+0000 7fc83bfff700 1 -- 172.21.15.129:0/3495103859 wait complete. 2020-01-26T15:24:05.916 INFO:teuthology.orchestra.run.smithi129.stdout:38654705698 2020-01-26T15:24:05.921 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:24:06.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 Processor -- start 2020-01-26T15:24:06.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- start start 2020-01-26T15:24:06.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 0x7f83f00a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:06.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 0x7f83f005ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:06.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00a5b80 con 0x7f83f005efa0 2020-01-26T15:24:06.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f83f00a43f0 con 0x7f83f00a5750 2020-01-26T15:24:06.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f83f00a4f80 con 0x7f83f00a4b50 2020-01-26T15:24:06.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f6c75700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 0x7f83f00a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:06.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f6474700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 0x7f83f005ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:06.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f6c75700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 0x7f83f00a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f6474700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 0x7f83f005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f7476700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f83f005efa0 0x7f83f014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44798/0 (socket says 172.21.15.129:44798) 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f7476700 1 -- 172.21.15.129:0/736899285 learned_addr learned my addr 172.21.15.129:0/736899285 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710202079 0 0) 0x7f83f00a5b80 con 0x7f83f005efa0 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d8003230 con 0x7f83f005efa0 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2655123226 0 0) 0x7f83d8003230 con 0x7f83f005efa0 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 msgr2=0x7f83f005ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 --2- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 0x7f83f005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 msgr2=0x7f83f00a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 --2- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 0x7f83f00a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0080440 con 0x7f83f005efa0 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f83e00016e0 con 0x7f83f005efa0 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f83e0001b10 con 0x7f83f005efa0 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f5c73700 1 -- 172.21.15.129:0/736899285 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f83e0004730 con 0x7f83f005efa0 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- 172.21.15.129:0/736899285 >> v1:172.21.15.129:6791/0 conn(0x7f83f005efa0 legacy=0x7f83f014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- 172.21.15.129:0/736899285 shutdown_connections 2020-01-26T15:24:06.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 --2- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6790/0 conn(0x7f83f00a5750 0x7f83f00a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 --2- 172.21.15.129:0/736899285 >> v2:172.21.15.129:6791/0 conn(0x7f83f00a4b50 0x7f83f005ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- 172.21.15.129:0/736899285 >> 172.21.15.129:0/736899285 conn(0x7f83f005e050 msgr2=0x7f83f0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- 172.21.15.129:0/736899285 shutdown_connections 2020-01-26T15:24:06.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.018+0000 7f83f86d8700 1 -- 172.21.15.129:0/736899285 wait complete. 2020-01-26T15:24:06.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 Processor -- start 2020-01-26T15:24:06.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- start start 2020-01-26T15:24:06.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f83f0138910 0x7f83f013ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:06.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f00937a0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f013c2b0 con 0x7f83f01215e0 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f83f0133e30 con 0x7f83f0138910 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f6c75700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f83f01215e0 0x7f83f00a1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47184/0 (socket says 172.21.15.129:47184) 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f6c75700 1 -- 172.21.15.129:0/547432839 learned_addr learned my addr 172.21.15.129:0/547432839 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f7476700 -1 --2- 172.21.15.129:0/547432839 >> v2:172.21.15.129:6791/0 conn(0x7f83f0138910 0x7f83f013ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f7476700 1 --2- 172.21.15.129:0/547432839 >> v2:172.21.15.129:6791/0 conn(0x7f83f0138910 0x7f83f013ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167254771 0 0) 0x7f83f00937a0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003230 con 0x7f83f00a1cd0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176017324 0 0) 0x7f83f013c2b0 con 0x7f83f01215e0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f00937a0 con 0x7f83f01215e0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3348160099 0 0) 0x7f83d0003230 con 0x7f83f00a1cd0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83f013c2b0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f83e4002a40 con 0x7f83f00a1cd0 2020-01-26T15:24:06.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3338629619 0 0) 0x7f83f00937a0 con 0x7f83f01215e0 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83d0003230 con 0x7f83f01215e0 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f83e8002650 con 0x7f83f01215e0 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3420440895 0 0) 0x7f83f013c2b0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 >> v2:172.21.15.129:6791/0 conn(0x7f83f0138910 msgr2=0x7f83f013ad50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 --2- 172.21.15.129:0/547432839 >> v2:172.21.15.129:6791/0 conn(0x7f83f0138910 0x7f83f013ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 >> v1:172.21.15.129:6790/0 conn(0x7f83f01215e0 legacy=0x7f83f00a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f013d4f0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f013b2a0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f013b5d0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f83e4001320 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f83e40016d0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f83e4001f00 con 0x7f83f00a1cd0 2020-01-26T15:24:06.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f83e4007ac0 con 0x7f83f00a1cd0 2020-01-26T15:24:06.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.022+0000 7f83f6c75700 1 -- 172.21.15.129:0/547432839 >> v1:172.21.15.129:6800/11038 conn(0x7f83d0005f70 legacy=0x7f83d00083e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:06.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.026+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6813/11410 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83cc005480 con 0x7f83cc0015e0 2020-01-26T15:24:06.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.026+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== osd.2 v1:172.21.15.129:6813/11410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7f83cc005480 con 0x7f83cc0015e0 2020-01-26T15:24:06.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 --> v1:172.21.15.129:6813/11410 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83cc006df0 con 0x7f83cc0015e0 2020-01-26T15:24:06.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83ef7fe700 1 -- 172.21.15.129:0/547432839 <== osd.2 v1:172.21.15.129:6813/11410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4185362170) 0x7f83cc006df0 con 0x7f83cc0015e0 2020-01-26T15:24:06.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 >> v1:172.21.15.129:6813/11410 conn(0x7f83cc0015e0 legacy=0x7f83cc003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 >> v1:172.21.15.129:6800/11038 conn(0x7f83d0005f70 legacy=0x7f83d00083e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 >> v1:172.21.15.129:6789/0 conn(0x7f83f00a1cd0 legacy=0x7f83f01334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f7476700 1 -- 172.21.15.129:0/547432839 reap_dead start 2020-01-26T15:24:06.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 shutdown_connections 2020-01-26T15:24:06.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 >> 172.21.15.129:0/547432839 conn(0x7f83f007f730 msgr2=0x7f83f00a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 shutdown_connections 2020-01-26T15:24:06.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.034+0000 7f83f86d8700 1 -- 172.21.15.129:0/547432839 wait complete. 2020-01-26T15:24:06.041 INFO:teuthology.orchestra.run.smithi129.stdout:38654705698 2020-01-26T15:24:06.047 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:24:06.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 Processor -- start 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- start start 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 0x7f03b005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b0098000 con 0x7f03b0149040 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b005e050 con 0x7f03b00a6870 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f03b00a6ca0 con 0x7f03b005edd0 2020-01-26T15:24:06.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5131700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 0x7f03b005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5131700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 0x7f03b005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b6b94700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f03b0149040 0x7f03b014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38900/0 (socket says 172.21.15.129:38900) 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b6b94700 1 -- 172.21.15.129:0/216644915 learned_addr learned my addr 172.21.15.129:0/216644915 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b4930700 1 --1- 172.21.15.129:0/216644915 >> v1:172.21.15.129:6791/0 conn(0x7f03b00a6870 0x7f03b007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44814/0 (socket says 172.21.15.129:44814) 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066638098 0 0) 0x7f03b005e050 con 0x7f03b00a6870 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039c003230 con 0x7f03b00a6870 2020-01-26T15:24:06.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038468031 0 0) 0x7f03b0098000 con 0x7f03b0149040 2020-01-26T15:24:06.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b005e050 con 0x7f03b0149040 2020-01-26T15:24:06.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1396224679 0 0) 0x7f03b005e050 con 0x7f03b0149040 2020-01-26T15:24:06.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 msgr2=0x7f03b005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:06.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 --2- 172.21.15.129:0/216644915 >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 0x7f03b005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 >> v1:172.21.15.129:6791/0 conn(0x7f03b00a6870 legacy=0x7f03b007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b014ecb0 con 0x7f03b0149040 2020-01-26T15:24:06.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f03ac001640 con 0x7f03b0149040 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f03ac001930 con 0x7f03b0149040 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03a7fff700 1 -- 172.21.15.129:0/216644915 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f03ac0045b0 con 0x7f03b0149040 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- 172.21.15.129:0/216644915 >> v1:172.21.15.129:6789/0 conn(0x7f03b0149040 legacy=0x7f03b014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- 172.21.15.129:0/216644915 shutdown_connections 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 --2- 172.21.15.129:0/216644915 >> v2:172.21.15.129:6790/0 conn(0x7f03b005edd0 0x7f03b005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- 172.21.15.129:0/216644915 >> 172.21.15.129:0/216644915 conn(0x7f03b0098e70 msgr2=0x7f03b00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- 172.21.15.129:0/216644915 shutdown_connections 2020-01-26T15:24:06.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.154+0000 7f03b5932700 1 -- 172.21.15.129:0/216644915 wait complete. 2020-01-26T15:24:06.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 Processor -- start 2020-01-26T15:24:06.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- start start 2020-01-26T15:24:06.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f03b0133ef0 0x7f03b013baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:06.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00a36c0 con 0x7f03b00a1410 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b0120950 con 0x7f03b01332c0 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f03b005bdd0 con 0x7f03b0133ef0 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b4930700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f03b01332c0 0x7f03b01336f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47206/0 (socket says 172.21.15.129:47206) 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b4930700 1 -- 172.21.15.129:0/2768707609 learned_addr learned my addr 172.21.15.129:0/2768707609 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b6b94700 -1 --2- 172.21.15.129:0/2768707609 >> v2:172.21.15.129:6791/0 conn(0x7f03b0133ef0 0x7f03b013baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b6b94700 1 --2- 172.21.15.129:0/2768707609 >> v2:172.21.15.129:6791/0 conn(0x7f03b0133ef0 0x7f03b013baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727461915 0 0) 0x7f03b00a36c0 con 0x7f03b00a1410 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0390003230 con 0x7f03b00a1410 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834205947 0 0) 0x7f03b0120950 con 0x7f03b01332c0 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b00a36c0 con 0x7f03b01332c0 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 464951275 0 0) 0x7f03b00a36c0 con 0x7f03b01332c0 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03b0120950 con 0x7f03b01332c0 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2871885395 0 0) 0x7f0390003230 con 0x7f03b00a1410 2020-01-26T15:24:06.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03b00a36c0 con 0x7f03b00a1410 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f03a00018e0 con 0x7f03b01332c0 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f03a80029c0 con 0x7f03b00a1410 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3148786508 0 0) 0x7f03b0120950 con 0x7f03b01332c0 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 >> v2:172.21.15.129:6791/0 conn(0x7f03b0133ef0 msgr2=0x7f03b013baa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 --2- 172.21.15.129:0/2768707609 >> v2:172.21.15.129:6791/0 conn(0x7f03b0133ef0 0x7f03b013baa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 >> v1:172.21.15.129:6789/0 conn(0x7f03b00a1410 legacy=0x7f03b0120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00a69b0 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b009e0a0 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b0024cc0 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f03a00047a0 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f03a0004990 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f03a0005280 con 0x7f03b01332c0 2020-01-26T15:24:06.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f03a0007810 con 0x7f03b01332c0 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5131700 1 -- 172.21.15.129:0/2768707609 >> v1:172.21.15.129:6800/11038 conn(0x7f0390006010 legacy=0x7f0390008480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.158+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6805/11407 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0388005480 con 0x7f03880015e0 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.162+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== osd.3 v1:172.21.15.129:6805/11407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4948 (unknown 0 0 1906538568) 0x7f0388005480 con 0x7f03880015e0 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 --> v1:172.21.15.129:6805/11407 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0388006df0 con 0x7f03880015e0 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03a5ffb700 1 -- 172.21.15.129:0/2768707609 <== osd.3 v1:172.21.15.129:6805/11407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4185362170) 0x7f0388006df0 con 0x7f03880015e0 2020-01-26T15:24:06.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 >> v1:172.21.15.129:6805/11407 conn(0x7f03880015e0 legacy=0x7f0388003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 >> v1:172.21.15.129:6800/11038 conn(0x7f0390006010 legacy=0x7f0390008480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 >> v1:172.21.15.129:6790/0 conn(0x7f03b01332c0 legacy=0x7f03b01336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b6b94700 1 -- 172.21.15.129:0/2768707609 reap_dead start 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 shutdown_connections 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 >> 172.21.15.129:0/2768707609 conn(0x7f03b00a7a70 msgr2=0x7f03b00a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 shutdown_connections 2020-01-26T15:24:06.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.166+0000 7f03b5932700 1 -- 172.21.15.129:0/2768707609 wait complete. 2020-01-26T15:24:06.197 INFO:teuthology.orchestra.run.smithi129.stdout:38654705698 2020-01-26T15:24:06.197 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:06.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 Processor -- start 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 -- start start 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 0x7f057c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0a5b80 con 0x7f057c1495c0 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c080440 con 0x7f057c0a5750 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0a43f0 con 0x7f057c146c30 2020-01-26T15:24:06.301 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f05827f4700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f057c1495c0 0x7f057c14ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38916/0 (socket says 172.21.15.129:38916) 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f05827f4700 1 -- 172.21.15.129:0/2891440405 learned_addr learned my addr 172.21.15.129:0/2891440405 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f05817f2700 -1 --2- 172.21.15.129:0/2891440405 >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 0x7f057c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f05817f2700 1 --2- 172.21.15.129:0/2891440405 >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 0x7f057c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525266700 0 0) 0x7f057c0a5b80 con 0x7f057c1495c0 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0568003230 con 0x7f057c1495c0 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14755061 0 0) 0x7f057c080440 con 0x7f057c0a5750 2020-01-26T15:24:06.302 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c0a5b80 con 0x7f057c0a5750 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2283767507 0 0) 0x7f057c0a5b80 con 0x7f057c0a5750 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 msgr2=0x7f057c149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 --2- 172.21.15.129:0/2891440405 >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 0x7f057c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 >> v1:172.21.15.129:6789/0 conn(0x7f057c1495c0 legacy=0x7f057c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0a4e00 con 0x7f057c0a5750 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f05780015f0 con 0x7f057c0a5750 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0578001960 con 0x7f057c0a5750 2020-01-26T15:24:06.303 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0580ff1700 1 -- 172.21.15.129:0/2891440405 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0578001dc0 con 0x7f057c0a5750 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.294+0000 7f0583a56700 1 -- 172.21.15.129:0/2891440405 >> v1:172.21.15.129:6791/0 conn(0x7f057c0a5750 legacy=0x7f057c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/2891440405 shutdown_connections 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 --2- 172.21.15.129:0/2891440405 >> v2:172.21.15.129:6790/0 conn(0x7f057c146c30 0x7f057c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/2891440405 >> 172.21.15.129:0/2891440405 conn(0x7f057c05e050 msgr2=0x7f057c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/2891440405 shutdown_connections 2020-01-26T15:24:06.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/2891440405 wait complete. 2020-01-26T15:24:06.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 Processor -- start 2020-01-26T15:24:06.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- start start 2020-01-26T15:24:06.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 0x7f057c1333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 0x7f057c133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c130260 con 0x7f057c12fe30 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f057c05b370 con 0x7f057c11ef10 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f057c130560 con 0x7f057c133940 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05817f2700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 0x7f057c1333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05817f2700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 0x7f057c1333f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05827f4700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 0x7f057c133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05827f4700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 0x7f057c133d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0581ff3700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f057c12fe30 0x7f057c11e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38918/0 (socket says 172.21.15.129:38918) 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0581ff3700 1 -- 172.21.15.129:0/535341592 learned_addr learned my addr 172.21.15.129:0/535341592 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601927179 0 0) 0x7f057c130260 con 0x7f057c12fe30 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564003230 con 0x7f057c12fe30 2020-01-26T15:24:06.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4223183551 0 0) 0x7f0564003230 con 0x7f057c12fe30 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f057c130260 con 0x7f057c12fe30 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0578001b40 con 0x7f057c12fe30 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3811118900 0 0) 0x7f057c130260 con 0x7f057c12fe30 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 msgr2=0x7f057c133d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 --2- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 0x7f057c133d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 msgr2=0x7f057c1333f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 --2- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 0x7f057c1333f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c11f340 con 0x7f057c12fe30 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c11fb40 con 0x7f057c12fe30 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c0a27b0 con 0x7f057c12fe30 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0578001140 con 0x7f057c12fe30 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f05780025c0 con 0x7f057c12fe30 2020-01-26T15:24:06.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7f0578005680 con 0x7f057c12fe30 2020-01-26T15:24:06.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7f0578007970 con 0x7f057c12fe30 2020-01-26T15:24:06.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.298+0000 7f05817f2700 1 -- 172.21.15.129:0/535341592 >> v1:172.21.15.129:6800/11038 conn(0x7f0564005170 legacy=0x7f0564007f60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:06.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.302+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558003360 con 0x7f057c12fe30 2020-01-26T15:24:06.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.302+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7f05780027c0 con 0x7f057c12fe30 2020-01-26T15:24:06.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.374+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05580037e0 con 0x7f057c12fe30 2020-01-26T15:24:06.379 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.374+0000 7f05727fc700 1 -- 172.21.15.129:0/535341592 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 504267783) 0x7f0578002ba0 con 0x7f057c12fe30 2020-01-26T15:24:06.379 INFO:teuthology.orchestra.run.smithi129.stdout:38654705697 2020-01-26T15:24:06.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.374+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 >> v1:172.21.15.129:6800/11038 conn(0x7f0564005170 legacy=0x7f0564007f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:06.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.374+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 >> v1:172.21.15.129:6789/0 conn(0x7f057c12fe30 legacy=0x7f057c11e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:06.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 shutdown_connections 2020-01-26T15:24:06.380 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 --2- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6791/0 conn(0x7f057c133940 0x7f057c133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.381 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 --2- 172.21.15.129:0/535341592 >> v2:172.21.15.129:6790/0 conn(0x7f057c11ef10 0x7f057c1333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:06.381 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 >> 172.21.15.129:0/535341592 conn(0x7f057c0950c0 msgr2=0x7f057c122bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:06.381 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 shutdown_connections 2020-01-26T15:24:06.381 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:06.378+0000 7f0583a56700 1 -- 172.21.15.129:0/535341592 wait complete. 2020-01-26T15:24:06.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2020-01-26T15:24:07.393 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:07.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 Processor -- start 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- start start 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 0x7fb5c014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c005ea20 con 0x7fb5c005edd0 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c0098000 con 0x7fb5c005e5f0 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c005e050 con 0x7fb5c00a6870 2020-01-26T15:24:07.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bf7fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb5c005edd0 0x7fb5c007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:38944/0 (socket says 172.21.15.129:38944) 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bf7fe700 1 -- 172.21.15.129:0/2469916510 learned_addr learned my addr 172.21.15.129:0/2469916510 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5c5444700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 0x7fb5c014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5beffd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fb5c005e5f0 0x7fb5c0149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44862/0 (socket says 172.21.15.129:44862) 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5c5444700 1 --2- 172.21.15.129:0/2469916510 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 0x7fb5c014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960765720 0 0) 0x7fb5c0098000 con 0x7fb5c005e5f0 2020-01-26T15:24:07.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ac003230 con 0x7fb5c005e5f0 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369639828 0 0) 0x7fb5c005ea20 con 0x7fb5c005edd0 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c0098000 con 0x7fb5c005edd0 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2668063376 0 0) 0x7fb5ac003230 con 0x7fb5c005e5f0 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 msgr2=0x7fb5c014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 --2- 172.21.15.129:0/2469916510 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 0x7fb5c014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 >> v1:172.21.15.129:6789/0 conn(0x7fb5c005edd0 legacy=0x7fb5c007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:07.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00a6ca0 con 0x7fb5c005e5f0 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb5a80016e0 con 0x7fb5c005e5f0 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb5a80019d0 con 0x7fb5c005e5f0 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5be7fc700 1 -- 172.21.15.129:0/2469916510 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb5a80044f0 con 0x7fb5c005e5f0 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- 172.21.15.129:0/2469916510 >> v1:172.21.15.129:6791/0 conn(0x7fb5c005e5f0 legacy=0x7fb5c0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- 172.21.15.129:0/2469916510 shutdown_connections 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 --2- 172.21.15.129:0/2469916510 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a6870 0x7fb5c014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:07.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- 172.21.15.129:0/2469916510 >> 172.21.15.129:0/2469916510 conn(0x7fb5c0098e70 msgr2=0x7fb5c00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:07.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- 172.21.15.129:0/2469916510 shutdown_connections 2020-01-26T15:24:07.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.498+0000 7fb5bffff700 1 -- 172.21.15.129:0/2469916510 wait complete. 2020-01-26T15:24:07.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 Processor -- start 2020-01-26T15:24:07.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- start start 2020-01-26T15:24:07.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 0x7fb5c0099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:07.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 0x7fb5c007ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:07.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c007d240 con 0x7fb5c0099f50 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c009ef60 con 0x7fb5c011f640 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c011fbc0 con 0x7fb5c00a0d20 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bf7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 0x7fb5c0099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5beffd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb5c0099f50 0x7fb5c007c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47252/0 (socket says 172.21.15.129:47252) 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5beffd700 1 -- 172.21.15.129:0/3607553223 learned_addr learned my addr 172.21.15.129:0/3607553223 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bf7fe700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 0x7fb5c0099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:07.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5c5444700 -1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 0x7fb5c007ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5c5444700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 0x7fb5c007ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857237455 0 0) 0x7fb5c007d240 con 0x7fb5c0099f50 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5a4003230 con 0x7fb5c0099f50 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1168729854 0 0) 0x7fb5a4003230 con 0x7fb5c0099f50 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5c007d240 con 0x7fb5c0099f50 2020-01-26T15:24:07.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb5a8001930 con 0x7fb5c0099f50 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3190888643 0 0) 0x7fb5c007d240 con 0x7fb5c0099f50 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 msgr2=0x7fb5c0099a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 0x7fb5c0099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 msgr2=0x7fb5c007ccf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 0x7fb5c007ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00a1150 con 0x7fb5c0099f50 2020-01-26T15:24:07.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c009a380 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0137820 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb5a8004a70 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb5a8004c60 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 4) v1 ==== 1474+0+0 (unknown 1663586925 0 0) 0x7fb5a8005490 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 2811+0+0 (unknown 2051107912 0 0) 0x7fb5a8007aa0 con 0x7fb5c0099f50 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.502+0000 7fb5bf7fe700 1 -- 172.21.15.129:0/3607553223 >> v1:172.21.15.129:6800/11038 conn(0x7fb5a40050d0 legacy=0x7fb5a4007ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.129:6800/11038 2020-01-26T15:24:07.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.506+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb598003360 con 0x7fb5c0099f50 2020-01-26T15:24:07.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.510+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7fb5a8004e60 con 0x7fb5c0099f50 2020-01-26T15:24:07.586 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.582+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5980037e0 con 0x7fb5c0099f50 2020-01-26T15:24:07.587 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.582+0000 7fb5b7fff700 1 -- 172.21.15.129:0/3607553223 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 504267783) 0x7fb5a8005140 con 0x7fb5c0099f50 2020-01-26T15:24:07.587 INFO:teuthology.orchestra.run.smithi129.stdout:38654705697 2020-01-26T15:24:07.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 >> v1:172.21.15.129:6800/11038 conn(0x7fb5a40050d0 legacy=0x7fb5a4007ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:07.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 >> v1:172.21.15.129:6790/0 conn(0x7fb5c0099f50 legacy=0x7fb5c007c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:07.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 shutdown_connections 2020-01-26T15:24:07.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6790/0 conn(0x7fb5c011f640 0x7fb5c007ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:07.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 --2- 172.21.15.129:0/3607553223 >> v2:172.21.15.129:6791/0 conn(0x7fb5c00a0d20 0x7fb5c0099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:07.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 >> 172.21.15.129:0/3607553223 conn(0x7fb5c01230b0 msgr2=0x7fb5c007f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:07.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 shutdown_connections 2020-01-26T15:24:07.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:07.586+0000 7fb5bffff700 1 -- 172.21.15.129:0/3607553223 wait complete. 2020-01-26T15:24:07.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2020-01-26T15:24:08.603 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:08.644 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.642+0000 7f78793bf700 -1 --2- 172.21.15.129:0/526490532 >> v2:172.21.15.129:6791/0 conn(0x55c64a73b680 0x55c64a8b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.647 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.642+0000 7f78793bf700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x55c64a73b680 0x55c64a8b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.647 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.642+0000 7f7879bc0700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x55c64a73c880 0x55c64a8b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.651 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.646+0000 7f7860056700 -1 librbd::api::Namespace: list: error listing namespaces: (95) Operation not supported 2020-01-26T15:24:08.655 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.654+0000 7f78793bf700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x55c64a73da80 0x55c64a8b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.656 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.654+0000 7f7878bbe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x55c64a8eed80 0x55c64a8b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.658 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.654+0000 7f7878bbe700 -1 --2- 172.21.15.129:0/2795254467 >> v2:172.21.15.129:6791/0 conn(0x55c64a8efb00 0x55c64a8b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.674 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.670+0000 7f7878bbe700 -1 --2- 172.21.15.129:0/1667899793 >> v2:172.21.15.129:6790/0 conn(0x55c64a9c1600 0x55c64a8ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.677 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f784e833700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:24:08.677 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f784e833700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:24:08.677 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f784e833700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:24:08.677 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f784e833700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:24:08.678 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f784e833700 -1 client.0 error registering admin socket command: (17) File exists 2020-01-26T15:24:08.678 INFO:tasks.ceph.mgr.x.smithi129.stderr:2020-01-26T15:24:08.674+0000 7f78793bf700 -1 --2- 172.21.15.129:0/2602703501 >> v2:172.21.15.129:6790/0 conn(0x55c64aa24d80 0x55c64a8ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 Processor -- start 2020-01-26T15:24:08.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- start start 2020-01-26T15:24:08.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 0x7fa7640a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:08.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 0x7fa76414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640a6dc0 con 0x7fa76405edd0 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa76405ea20 con 0x7fa76405e5f0 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa764098000 con 0x7fa764149040 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa769d97700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa76405edd0 0x7fa76407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39016/0 (socket says 172.21.15.129:39016) 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa769d97700 1 -- 172.21.15.129:0/3749451786 learned_addr learned my addr 172.21.15.129:0/3749451786 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa769596700 -1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 0x7fa7640a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa769596700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 0x7fa7640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76b7fa700 -1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 0x7fa76414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76b7fa700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 0x7fa76414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549629740 0 0) 0x7fa7640a6dc0 con 0x7fa76405edd0 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa74c003230 con 0x7fa76405edd0 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3822312094 0 0) 0x7fa74c003230 con 0x7fa76405edd0 2020-01-26T15:24:08.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 msgr2=0x7fa76414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 0x7fa76414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 msgr2=0x7fa7640a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 0x7fa7640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76405e050 con 0x7fa76405edd0 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa7580016e0 con 0x7fa76405edd0 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa758001b10 con 0x7fa76405edd0 2020-01-26T15:24:08.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa768d95700 1 -- 172.21.15.129:0/3749451786 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa758004730 con 0x7fa76405edd0 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- 172.21.15.129:0/3749451786 >> v1:172.21.15.129:6789/0 conn(0x7fa76405edd0 legacy=0x7fa76407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- 172.21.15.129:0/3749451786 shutdown_connections 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6791/0 conn(0x7fa764149040 0x7fa76414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 --2- 172.21.15.129:0/3749451786 >> v2:172.21.15.129:6790/0 conn(0x7fa76405e5f0 0x7fa7640a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- 172.21.15.129:0/3749451786 >> 172.21.15.129:0/3749451786 conn(0x7fa764098e70 msgr2=0x7fa7640a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- 172.21.15.129:0/3749451786 shutdown_connections 2020-01-26T15:24:08.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.706+0000 7fa76a598700 1 -- 172.21.15.129:0/3749451786 wait complete. 2020-01-26T15:24:08.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 Processor -- start 2020-01-26T15:24:08.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- start start 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 0x7fa76407ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 0x7fa764099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640a2710 con 0x7fa764099f50 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640a2240 con 0x7fa7640a3d00 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640a4130 con 0x7fa76407cfb0 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa769596700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 0x7fa764099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa769d97700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 0x7fa76407ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:08.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa769d97700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 0x7fa76407ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa769596700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 0x7fa764099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76b7fa700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fa764099f50 0x7fa7640a0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47326/0 (socket says 172.21.15.129:47326) 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76b7fa700 1 -- 172.21.15.129:0/3277136328 learned_addr learned my addr 172.21.15.129:0/3277136328 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575546757 0 0) 0x7fa7640a2710 con 0x7fa764099f50 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa744003230 con 0x7fa764099f50 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3927992916 0 0) 0x7fa744003230 con 0x7fa764099f50 2020-01-26T15:24:08.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7640a2710 con 0x7fa764099f50 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa75c001970 con 0x7fa764099f50 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2072739974 0 0) 0x7fa7640a2710 con 0x7fa764099f50 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 msgr2=0x7fa764099a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 --2- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 0x7fa764099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 msgr2=0x7fa76407ca60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 --2- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 0x7fa76407ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:08.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76407d3e0 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76409a380 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764121a50 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa75c002240 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa75c002660 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764056600 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 5) v1 ==== 47000+0+0 (unknown 2265550017 0 0) 0x7fa75c002860 con 0x7fa764099f50 2020-01-26T15:24:08.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.710+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7fa75c04ba50 con 0x7fa764099f50 2020-01-26T15:24:08.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.714+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+76359 (unknown 1092875540 0 88704339) 0x7fa75c0312d0 con 0x7fa764099f50 2020-01-26T15:24:08.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa76405cc60 con 0x7fa764099f50 2020-01-26T15:24:08.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa7627fc700 1 -- 172.21.15.129:0/3277136328 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 504267783) 0x7fa75c04a9c0 con 0x7fa764099f50 2020-01-26T15:24:08.788 INFO:teuthology.orchestra.run.smithi129.stdout:38654705697 2020-01-26T15:24:08.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 >> v1:172.21.15.129:6790/0 conn(0x7fa764099f50 legacy=0x7fa7640a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:08.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 shutdown_connections 2020-01-26T15:24:08.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 --2- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6790/0 conn(0x7fa7640a3d00 0x7fa76407ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:08.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 --2- 172.21.15.129:0/3277136328 >> v2:172.21.15.129:6791/0 conn(0x7fa76407cfb0 0x7fa764099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:08.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 >> 172.21.15.129:0/3277136328 conn(0x7fa764098e10 msgr2=0x7fa764097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:08.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 shutdown_connections 2020-01-26T15:24:08.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:08.786+0000 7fa76a598700 1 -- 172.21.15.129:0/3277136328 wait complete. 2020-01-26T15:24:08.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2020-01-26T15:24:09.800 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:09.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 Processor -- start 2020-01-26T15:24:09.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 -- start start 2020-01-26T15:24:09.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 0x7f99100a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:09.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 0x7f991014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:09.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100a5b80 con 0x7f99100a4b50 2020-01-26T15:24:09.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f99100a43f0 con 0x7f99100a5750 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f99177ba700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f99100a4f80 con 0x7f991005f250 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9915556700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f99100a4b50 0x7f991005ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39054/0 (socket says 172.21.15.129:39054) 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9915d57700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 0x7f99100a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9915556700 1 -- 172.21.15.129:0/2412370659 learned_addr learned my addr 172.21.15.129:0/2412370659 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9916558700 -1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 0x7f991014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9915d57700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 0x7f99100a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:09.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.910+0000 7f9916558700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 0x7f991014bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546611238 0 0) 0x7f99100a5b80 con 0x7f99100a4b50 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98fc003230 con 0x7f99100a4b50 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1346235370 0 0) 0x7f98fc003230 con 0x7f99100a4b50 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 msgr2=0x7f991014bc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 0x7f991014bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 msgr2=0x7f99100a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 0x7f99100a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910080440 con 0x7f99100a4b50 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f99000016e0 con 0x7f99100a4b50 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f9900001b10 con 0x7f99100a4b50 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f9914d55700 1 -- 172.21.15.129:0/2412370659 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f9900004730 con 0x7f99100a4b50 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 -- 172.21.15.129:0/2412370659 >> v1:172.21.15.129:6789/0 conn(0x7f99100a4b50 legacy=0x7f991005ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 -- 172.21.15.129:0/2412370659 shutdown_connections 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6790/0 conn(0x7f99100a5750 0x7f99100a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 --2- 172.21.15.129:0/2412370659 >> v2:172.21.15.129:6791/0 conn(0x7f991005f250 0x7f991014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:09.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 -- 172.21.15.129:0/2412370659 >> 172.21.15.129:0/2412370659 conn(0x7f991005e050 msgr2=0x7f9910098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:09.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 -- 172.21.15.129:0/2412370659 shutdown_connections 2020-01-26T15:24:09.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.914+0000 7f99177ba700 1 -- 172.21.15.129:0/2412370659 wait complete. 2020-01-26T15:24:09.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 Processor -- start 2020-01-26T15:24:09.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 -- start start 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 0x7f9910061c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991012c830 con 0x7f9910060220 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100970d0 con 0x7f991007c9e0 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99177ba700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f9910121eb0 con 0x7f9910060650 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f9915556700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 0x7f9910061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f9915556700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 0x7f9910061c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:09.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f9915d57700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f9910060220 0x7f9910061450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47358/0 (socket says 172.21.15.129:47358) 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f9916558700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f991007c9e0 0x7f991007ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44978/0 (socket says 172.21.15.129:44978) 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f9915d57700 1 -- 172.21.15.129:0/3824074964 learned_addr learned my addr 172.21.15.129:0/3824074964 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797602758 0 0) 0x7f991012c830 con 0x7f9910060220 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f8003230 con 0x7f9910060220 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819205290 0 0) 0x7f99100970d0 con 0x7f991007c9e0 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991012c830 con 0x7f991007c9e0 2020-01-26T15:24:09.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1821712947 0 0) 0x7f98f8003230 con 0x7f9910060220 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99100970d0 con 0x7f9910060220 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f990c002a90 con 0x7f9910060220 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2785300907 0 0) 0x7f991012c830 con 0x7f991007c9e0 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98f8003230 con 0x7f991007c9e0 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.918+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f99080015f0 con 0x7f991007c9e0 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3041622165 0 0) 0x7f99100970d0 con 0x7f9910060220 2020-01-26T15:24:09.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 msgr2=0x7f9910061c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 --2- 172.21.15.129:0/3824074964 >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 0x7f9910061c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 >> v1:172.21.15.129:6791/0 conn(0x7f991007c9e0 legacy=0x7f991007ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991011efa0 con 0x7f9910060220 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991007d610 con 0x7f9910060220 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9910096030 con 0x7f9910060220 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f990c001210 con 0x7f9910060220 2020-01-26T15:24:09.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f990c0015f0 con 0x7f9910060220 2020-01-26T15:24:09.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910056600 con 0x7f9910060220 2020-01-26T15:24:09.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 6) v1 ==== 47035+0+0 (unknown 3020793153 0 0) 0x7f990c0017f0 con 0x7f9910060220 2020-01-26T15:24:09.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.922+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f990c04bb00 con 0x7f9910060220 2020-01-26T15:24:09.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:09.930+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f990c031320 con 0x7f9910060220 2020-01-26T15:24:10.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.050+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f991005cc60 con 0x7f9910060220 2020-01-26T15:24:10.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99067fc700 1 -- 172.21.15.129:0/3824074964 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 504267783) 0x7f990c04aa70 con 0x7f9910060220 2020-01-26T15:24:10.056 INFO:teuthology.orchestra.run.smithi129.stdout:38654705697 2020-01-26T15:24:10.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 >> v1:172.21.15.129:6800/16899 conn(0x7f98f8040550 legacy=0x7f98f8042a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:10.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 >> v1:172.21.15.129:6790/0 conn(0x7f9910060220 legacy=0x7f9910061450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:10.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 shutdown_connections 2020-01-26T15:24:10.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 --2- 172.21.15.129:0/3824074964 >> v2:172.21.15.129:6790/0 conn(0x7f9910060650 0x7f9910061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:10.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 >> 172.21.15.129:0/3824074964 conn(0x7f99100979c0 msgr2=0x7f991007f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:10.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 shutdown_connections 2020-01-26T15:24:10.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:10.054+0000 7f99177ba700 1 -- 172.21.15.129:0/3824074964 wait complete. 2020-01-26T15:24:10.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.0 2020-01-26T15:24:11.069 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:11.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 Processor -- start 2020-01-26T15:24:11.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 -- start start 2020-01-26T15:24:11.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 0x7fa95405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:11.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 0x7fa95414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa954098000 con 0x7fa9540a6870 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa95405e050 con 0x7fa954149040 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.190+0000 7fa959dd5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa9540a6ca0 con 0x7fa95405edd0 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa958dd3700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa9540a6870 0x7fa95407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39068/0 (socket says 172.21.15.129:39068) 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa958dd3700 1 -- 172.21.15.129:0/594863291 learned_addr learned my addr 172.21.15.129:0/594863291 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa95b037700 -1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 0x7fa95414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:11.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa9595d4700 -1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 0x7fa95405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa9595d4700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 0x7fa95405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa95b037700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 0x7fa95414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989134931 0 0) 0x7fa954098000 con 0x7fa9540a6870 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c003230 con 0x7fa9540a6870 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1622216028 0 0) 0x7fa93c003230 con 0x7fa9540a6870 2020-01-26T15:24:11.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 msgr2=0x7fa95405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 0x7fa95405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 msgr2=0x7fa95414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 0x7fa95414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95414c9e0 con 0x7fa9540a6870 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa948001a60 con 0x7fa9540a6870 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa948001d00 con 0x7fa9540a6870 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa953fff700 1 -- 172.21.15.129:0/594863291 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa948004930 con 0x7fa9540a6870 2020-01-26T15:24:11.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 -- 172.21.15.129:0/594863291 >> v1:172.21.15.129:6789/0 conn(0x7fa9540a6870 legacy=0x7fa95407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 -- 172.21.15.129:0/594863291 shutdown_connections 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6790/0 conn(0x7fa954149040 0x7fa95414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 --2- 172.21.15.129:0/594863291 >> v2:172.21.15.129:6791/0 conn(0x7fa95405edd0 0x7fa95405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 -- 172.21.15.129:0/594863291 >> 172.21.15.129:0/594863291 conn(0x7fa954098e70 msgr2=0x7fa9540a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 -- 172.21.15.129:0/594863291 shutdown_connections 2020-01-26T15:24:11.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.194+0000 7fa959dd5700 1 -- 172.21.15.129:0/594863291 wait complete. 2020-01-26T15:24:11.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 Processor -- start 2020-01-26T15:24:11.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 -- start start 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 0x7fa95407ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa954099ee0 con 0x7fa954099ab0 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95409acd0 con 0x7fa95407d360 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa959dd5700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa95409a5a0 con 0x7fa95407c9e0 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa95b037700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fa95407d360 0x7fa9541385f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:44990/0 (socket says 172.21.15.129:44990) 2020-01-26T15:24:11.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa9595d4700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa954099ab0 0x7fa95409df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39072/0 (socket says 172.21.15.129:39072) 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa95b037700 1 -- 172.21.15.129:0/2366526103 learned_addr learned my addr 172.21.15.129:0/2366526103 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa958dd3700 -1 --2- 172.21.15.129:0/2366526103 >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 0x7fa95407ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa958dd3700 1 --2- 172.21.15.129:0/2366526103 >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 0x7fa95407ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081400319 0 0) 0x7fa95409acd0 con 0x7fa95407d360 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa934003230 con 0x7fa95407d360 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185354850 0 0) 0x7fa944000ee0 con 0x7fa954099ab0 2020-01-26T15:24:11.208 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95409acd0 con 0x7fa954099ab0 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3272468648 0 0) 0x7fa934003230 con 0x7fa95407d360 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa944000ee0 con 0x7fa95407d360 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa94c0015f0 con 0x7fa95407d360 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2006716472 0 0) 0x7fa95409acd0 con 0x7fa954099ab0 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa934003230 con 0x7fa954099ab0 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa944001820 con 0x7fa954099ab0 2020-01-26T15:24:11.209 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1525771527 0 0) 0x7fa944000ee0 con 0x7fa95407d360 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.198+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 msgr2=0x7fa95407ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 --2- 172.21.15.129:0/2366526103 >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 0x7fa95407ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 >> v1:172.21.15.129:6789/0 conn(0x7fa954099ab0 legacy=0x7fa95409df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540a4dd0 con 0x7fa95407d360 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9540a0db0 con 0x7fa95407d360 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9540a0a20 con 0x7fa95407d360 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa94c001ec0 con 0x7fa95407d360 2020-01-26T15:24:11.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa94c002320 con 0x7fa95407d360 2020-01-26T15:24:11.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fa94c0025a0 con 0x7fa95407d360 2020-01-26T15:24:11.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954056600 con 0x7fa95407d360 2020-01-26T15:24:11.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.202+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7fa94c04b870 con 0x7fa95407d360 2020-01-26T15:24:11.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.210+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fa94c030f50 con 0x7fa95407d360 2020-01-26T15:24:11.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa95405cc60 con 0x7fa95407d360 2020-01-26T15:24:11.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa951ffb700 1 -- 172.21.15.129:0/2366526103 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 3939833485) 0x7fa94c04a6a0 con 0x7fa95407d360 2020-01-26T15:24:11.336 INFO:teuthology.orchestra.run.smithi129.stdout:38654705699 2020-01-26T15:24:11.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 >> v1:172.21.15.129:6800/16899 conn(0x7fa93403e510 legacy=0x7fa934040a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 >> v1:172.21.15.129:6791/0 conn(0x7fa95407d360 legacy=0x7fa9541385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 shutdown_connections 2020-01-26T15:24:11.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 --2- 172.21.15.129:0/2366526103 >> v2:172.21.15.129:6790/0 conn(0x7fa95407c9e0 0x7fa95407ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:11.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 >> 172.21.15.129:0/2366526103 conn(0x7fa954122160 msgr2=0x7fa9541226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 shutdown_connections 2020-01-26T15:24:11.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.334+0000 7fa959dd5700 1 -- 172.21.15.129:0/2366526103 wait complete. 2020-01-26T15:24:11.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2020-01-26T15:24:11.350 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 Processor -- start 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 -- start start 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 0x7f449014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449005ea20 con 0x7f449005edd0 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4490098000 con 0x7f449005e5f0 2020-01-26T15:24:11.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448ffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f449005e050 con 0x7f44900a6870 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448f7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f449005edd0 0x7f449007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47380/0 (socket says 172.21.15.129:47380) 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f448f7fe700 1 -- 172.21.15.129:0/149337453 learned_addr learned my addr 172.21.15.129:0/149337453 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f44956a3700 -1 --2- 172.21.15.129:0/149337453 >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 0x7f449014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.458+0000 7f44956a3700 1 --2- 172.21.15.129:0/149337453 >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 0x7f449014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137959769 0 0) 0x7f449005ea20 con 0x7f449005edd0 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4470003230 con 0x7f449005edd0 2020-01-26T15:24:11.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741022689 0 0) 0x7f4490098000 con 0x7f449005e5f0 2020-01-26T15:24:11.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449005ea20 con 0x7f449005e5f0 2020-01-26T15:24:11.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3453672094 0 0) 0x7f4470003230 con 0x7f449005edd0 2020-01-26T15:24:11.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 msgr2=0x7f449014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:11.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 --2- 172.21.15.129:0/149337453 >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 0x7f449014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 >> v1:172.21.15.129:6791/0 conn(0x7f449005e5f0 legacy=0x7f4490149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900a6ca0 con 0x7f449005edd0 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f44780016e0 con 0x7f449005edd0 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f4478001a50 con 0x7f449005edd0 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448e7fc700 1 -- 172.21.15.129:0/149337453 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f44780045b0 con 0x7f449005edd0 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 -- 172.21.15.129:0/149337453 >> v1:172.21.15.129:6790/0 conn(0x7f449005edd0 legacy=0x7f449007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 -- 172.21.15.129:0/149337453 shutdown_connections 2020-01-26T15:24:11.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 --2- 172.21.15.129:0/149337453 >> v2:172.21.15.129:6791/0 conn(0x7f44900a6870 0x7f449014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 -- 172.21.15.129:0/149337453 >> 172.21.15.129:0/149337453 conn(0x7f4490098e70 msgr2=0x7f44900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 -- 172.21.15.129:0/149337453 shutdown_connections 2020-01-26T15:24:11.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.462+0000 7f448ffff700 1 -- 172.21.15.129:0/149337453 wait complete. 2020-01-26T15:24:11.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 Processor -- start 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- start start 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449009e6a0 con 0x7f4490133440 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4490133870 con 0x7f449007a1b0 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900a3a00 con 0x7f449007ab40 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448f7fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f449007ab40 0x7f449011e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45004/0 (socket says 172.21.15.129:45004) 2020-01-26T15:24:11.474 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448effd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4490133440 0x7f44900799b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39086/0 (socket says 172.21.15.129:39086) 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448f7fe700 1 -- 172.21.15.129:0/3675152249 learned_addr learned my addr 172.21.15.129:0/3675152249 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f44956a3700 1 --1- 172.21.15.129:0/3675152249 >> v1:172.21.15.129:6790/0 conn(0x7f449007a1b0 0x7f449013bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47390/0 (socket says 172.21.15.129:47390) 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124575982 0 0) 0x7f44900a3a00 con 0x7f449007ab40 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4468003230 con 0x7f449007ab40 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579405002 0 0) 0x7f449009e6a0 con 0x7f4490133440 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44900a3a00 con 0x7f4490133440 2020-01-26T15:24:11.475 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581390894 0 0) 0x7f4490133870 con 0x7f449007a1b0 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449009e6a0 con 0x7f449007a1b0 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2092091900 0 0) 0x7f4468003230 con 0x7f449007ab40 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4490133870 con 0x7f449007ab40 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f4478001420 con 0x7f449007ab40 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 944899717 0 0) 0x7f44900a3a00 con 0x7f4490133440 2020-01-26T15:24:11.476 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4468003230 con 0x7f4490133440 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f44800017a0 con 0x7f4490133440 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1330491071 0 0) 0x7f449009e6a0 con 0x7f449007a1b0 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f44900a3a00 con 0x7f449007a1b0 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f4488002900 con 0x7f449007a1b0 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1712365775 0 0) 0x7f4490133870 con 0x7f449007ab40 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 >> v1:172.21.15.129:6790/0 conn(0x7f449007a1b0 legacy=0x7f449013bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.477 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 >> v1:172.21.15.129:6789/0 conn(0x7f4490133440 legacy=0x7f44900799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449009e170 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449007a5e0 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f449013d2c0 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f4478001230 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.466+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f4478004a80 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.470+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f4478010540 con 0x7f449007ab40 2020-01-26T15:24:11.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.470+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c003360 con 0x7f449007ab40 2020-01-26T15:24:11.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.470+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f447804b8b0 con 0x7f449007ab40 2020-01-26T15:24:11.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.474+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4478030e50 con 0x7f449007ab40 2020-01-26T15:24:11.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.590+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f446c0037e0 con 0x7f449007ab40 2020-01-26T15:24:11.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.590+0000 7f4487fff700 1 -- 172.21.15.129:0/3675152249 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 3939833485) 0x7f44780310b0 con 0x7f449007ab40 2020-01-26T15:24:11.594 INFO:teuthology.orchestra.run.smithi129.stdout:38654705699 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 >> v1:172.21.15.129:6800/16899 conn(0x7f446803e870 legacy=0x7f4468040d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 >> v1:172.21.15.129:6791/0 conn(0x7f449007ab40 legacy=0x7f449011e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 shutdown_connections 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 >> 172.21.15.129:0/3675152249 conn(0x7f449007f500 msgr2=0x7f449007e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 shutdown_connections 2020-01-26T15:24:11.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.594+0000 7f448ffff700 1 -- 172.21.15.129:0/3675152249 wait complete. 2020-01-26T15:24:11.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.1 2020-01-26T15:24:11.606 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:24:11.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 Processor -- start 2020-01-26T15:24:11.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- start start 2020-01-26T15:24:11.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 0x7efd7c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:11.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 0x7efd7c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:11.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c098000 con 0x7efd7c0a6870 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c05e050 con 0x7efd7c05edd0 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c0a6ca0 con 0x7efd7c149040 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd808e5700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 0x7efd7c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd808e5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 0x7efd7c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd82348700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 0x7efd7c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7bfff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7efd7c0a6870 0x7efd7c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39096/0 (socket says 172.21.15.129:39096) 2020-01-26T15:24:11.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7bfff700 1 -- 172.21.15.129:0/1857739831 learned_addr learned my addr 172.21.15.129:0/1857739831 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd82348700 1 --2- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 0x7efd7c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131423804 0 0) 0x7efd7c098000 con 0x7efd7c0a6870 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd64003230 con 0x7efd7c0a6870 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 565887682 0 0) 0x7efd64003230 con 0x7efd7c0a6870 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 msgr2=0x7efd7c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 --2- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 0x7efd7c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 msgr2=0x7efd7c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 --2- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 0x7efd7c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c14c9e0 con 0x7efd7c0a6870 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7efd700016e0 con 0x7efd7c0a6870 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efd70001b10 con 0x7efd7c0a6870 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd7b7fe700 1 -- 172.21.15.129:0/1857739831 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7efd70004730 con 0x7efd7c0a6870 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- 172.21.15.129:0/1857739831 >> v1:172.21.15.129:6789/0 conn(0x7efd7c0a6870 legacy=0x7efd7c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- 172.21.15.129:0/1857739831 shutdown_connections 2020-01-26T15:24:11.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 --2- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6790/0 conn(0x7efd7c05edd0 0x7efd7c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 --2- 172.21.15.129:0/1857739831 >> v2:172.21.15.129:6791/0 conn(0x7efd7c149040 0x7efd7c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:11.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- 172.21.15.129:0/1857739831 >> 172.21.15.129:0/1857739831 conn(0x7efd7c098e70 msgr2=0x7efd7c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- 172.21.15.129:0/1857739831 shutdown_connections 2020-01-26T15:24:11.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.718+0000 7efd810e6700 1 -- 172.21.15.129:0/1857739831 wait complete. 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 Processor -- start 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- start start 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 0x7efd7c0a30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c122780 con 0x7efd7c1361a0 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c0a2c30 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c0a2e60 con 0x7efd7c11ea20 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd82348700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7efd7c1361a0 0x7efd7c1385e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39100/0 (socket says 172.21.15.129:39100) 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd82348700 1 -- 172.21.15.129:0/3437931406 learned_addr learned my addr 172.21.15.129:0/3437931406 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd7bfff700 -1 --2- 172.21.15.129:0/3437931406 >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 0x7efd7c0a30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd7bfff700 1 --2- 172.21.15.129:0/3437931406 >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 0x7efd7c0a30d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336888813 0 0) 0x7efd7c122780 con 0x7efd7c1361a0 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd5c003230 con 0x7efd7c1361a0 2020-01-26T15:24:11.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446008200 0 0) 0x7efd7c0a2c30 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd7c122780 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2728666832 0 0) 0x7efd5c003230 con 0x7efd7c1361a0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd7c0a2c30 con 0x7efd7c1361a0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7efd740015f0 con 0x7efd7c1361a0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1856798354 0 0) 0x7efd7c122780 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd5c003230 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7efd6c0019f0 con 0x7efd7c0a1fc0 2020-01-26T15:24:11.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3305601253 0 0) 0x7efd7c0a2c30 con 0x7efd7c1361a0 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 msgr2=0x7efd7c0a30d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 --2- 172.21.15.129:0/3437931406 >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 0x7efd7c0a30d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 >> v1:172.21.15.129:6790/0 conn(0x7efd7c0a1fc0 legacy=0x7efd7c12dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c05c0f0 con 0x7efd7c1361a0 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0a1410 con 0x7efd7c1361a0 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c12e4f0 con 0x7efd7c1361a0 2020-01-26T15:24:11.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7efd74001ec0 con 0x7efd7c1361a0 2020-01-26T15:24:11.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.722+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7efd74002320 con 0x7efd7c1361a0 2020-01-26T15:24:11.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.726+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd54003360 con 0x7efd7c1361a0 2020-01-26T15:24:11.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.726+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7efd740025e0 con 0x7efd7c1361a0 2020-01-26T15:24:11.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.726+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7efd7404b7b0 con 0x7efd7c1361a0 2020-01-26T15:24:11.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.730+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7efd74030e90 con 0x7efd7c1361a0 2020-01-26T15:24:11.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd540021f0 con 0x7efd7c1361a0 2020-01-26T15:24:11.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd797fa700 1 -- 172.21.15.129:0/3437931406 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 3939833485) 0x7efd7404a640 con 0x7efd7c1361a0 2020-01-26T15:24:11.853 INFO:teuthology.orchestra.run.smithi129.stdout:38654705699 2020-01-26T15:24:11.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 >> v1:172.21.15.129:6800/16899 conn(0x7efd5c03e450 legacy=0x7efd5c040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 >> v1:172.21.15.129:6789/0 conn(0x7efd7c1361a0 legacy=0x7efd7c1385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 shutdown_connections 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 --2- 172.21.15.129:0/3437931406 >> v2:172.21.15.129:6791/0 conn(0x7efd7c11ea20 0x7efd7c0a30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 >> 172.21.15.129:0/3437931406 conn(0x7efd7c0a5520 msgr2=0x7efd7c07f070 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 shutdown_connections 2020-01-26T15:24:11.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.850+0000 7efd810e6700 1 -- 172.21.15.129:0/3437931406 wait complete. 2020-01-26T15:24:11.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.2 2020-01-26T15:24:11.866 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:24:11.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.966+0000 7fdbd3a00700 1 Processor -- start 2020-01-26T15:24:11.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.966+0000 7fdbd3a00700 1 -- start start 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0a5b80 con 0x7fdbcc146c30 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc080440 con 0x7fdbcc14a880 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0a4e00 con 0x7fdbcc0a5750 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd1f9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdbcc0a5750 0x7fdbcc0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45022/0 (socket says 172.21.15.129:45022) 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd1f9d700 1 -- 172.21.15.129:0/3523548413 learned_addr learned my addr 172.21.15.129:0/3523548413 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd279e700 1 --1- 172.21.15.129:0/3523548413 >> v1:172.21.15.129:6790/0 conn(0x7fdbcc14a880 0x7fdbcc14ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47410/0 (socket says 172.21.15.129:47410) 2020-01-26T15:24:11.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582299212 0 0) 0x7fdbcc080440 con 0x7fdbcc14a880 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb8003230 con 0x7fdbcc14a880 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186192190 0 0) 0x7fdbcc0a4e00 con 0x7fdbcc0a5750 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc080440 con 0x7fdbcc0a5750 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893721654 0 0) 0x7fdbcc0a5b80 con 0x7fdbcc146c30 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc0a4e00 con 0x7fdbcc146c30 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 301197040 0 0) 0x7fdbcc080440 con 0x7fdbcc0a5750 2020-01-26T15:24:11.977 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 >> v1:172.21.15.129:6790/0 conn(0x7fdbcc14a880 legacy=0x7fdbcc14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 >> v1:172.21.15.129:6789/0 conn(0x7fdbcc146c30 legacy=0x7fdbcc149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc0a3210 con 0x7fdbcc0a5750 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fdbc80016c0 con 0x7fdbcc0a5750 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdbc80019b0 con 0x7fdbcc0a5750 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd0f9b700 1 -- 172.21.15.129:0/3523548413 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fdbc80045b0 con 0x7fdbcc0a5750 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3523548413 >> v1:172.21.15.129:6791/0 conn(0x7fdbcc0a5750 legacy=0x7fdbcc0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3523548413 shutdown_connections 2020-01-26T15:24:11.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3523548413 >> 172.21.15.129:0/3523548413 conn(0x7fdbcc05e050 msgr2=0x7fdbcc098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:11.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3523548413 shutdown_connections 2020-01-26T15:24:11.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.970+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3523548413 wait complete. 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 Processor -- start 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- start start 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 0x7fdbcc0619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0626c0 con 0x7fdbcc1368f0 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc061f30 con 0x7fdbcc095e90 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc063560 con 0x7fdbcc062290 2020-01-26T15:24:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd179c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdbcc095e90 0x7fdbcc0962c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45028/0 (socket says 172.21.15.129:45028) 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd279e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fdbcc1368f0 0x7fdbcc138d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47416/0 (socket says 172.21.15.129:47416) 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd179c700 1 -- 172.21.15.129:0/3356526525 learned_addr learned my addr 172.21.15.129:0/3356526525 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd1f9d700 -1 --2- 172.21.15.129:0/3356526525 >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 0x7fdbcc0619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd1f9d700 1 --2- 172.21.15.129:0/3356526525 >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 0x7fdbcc0619e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661517708 0 0) 0x7fdbc40015b0 con 0x7fdbcc1368f0 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb4003230 con 0x7fdbcc1368f0 2020-01-26T15:24:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406455542 0 0) 0x7fdbcc061f30 con 0x7fdbcc095e90 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc40015b0 con 0x7fdbcc095e90 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3209605180 0 0) 0x7fdbb4003230 con 0x7fdbcc1368f0 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbcc061f30 con 0x7fdbcc1368f0 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fdbc4001e30 con 0x7fdbcc1368f0 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3865208627 0 0) 0x7fdbc40015b0 con 0x7fdbcc095e90 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbb4003230 con 0x7fdbcc095e90 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fdbc0001750 con 0x7fdbcc095e90 2020-01-26T15:24:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2787599167 0 0) 0x7fdbcc061f30 con 0x7fdbcc1368f0 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 msgr2=0x7fdbcc0619e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 --2- 172.21.15.129:0/3356526525 >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 0x7fdbcc0619e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 >> v1:172.21.15.129:6791/0 conn(0x7fdbcc095e90 legacy=0x7fdbcc0962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc060390 con 0x7fdbcc1368f0 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0631b0 con 0x7fdbcc1368f0 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc095480 con 0x7fdbcc1368f0 2020-01-26T15:24:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdbc4004b20 con 0x7fdbcc1368f0 2020-01-26T15:24:11.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.974+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fdbc4004e90 con 0x7fdbcc1368f0 2020-01-26T15:24:11.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.978+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fdbc4010950 con 0x7fdbcc1368f0 2020-01-26T15:24:11.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.978+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc056600 con 0x7fdbcc1368f0 2020-01-26T15:24:11.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.978+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7fdbcc0626c0 con 0x7fdbcc1368f0 2020-01-26T15:24:11.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:11.978+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fdbc4031380 con 0x7fdbcc1368f0 2020-01-26T15:24:12.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.098+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdbcc05cc60 con 0x7fdbcc1368f0 2020-01-26T15:24:12.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.098+0000 7fdbbe7fc700 1 -- 172.21.15.129:0/3356526525 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 3939833485) 0x7fdbc404aad0 con 0x7fdbcc1368f0 2020-01-26T15:24:12.103 INFO:teuthology.orchestra.run.smithi129.stdout:38654705699 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 >> v1:172.21.15.129:6800/16899 conn(0x7fdbb403e4a0 legacy=0x7fdbb40409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 >> v1:172.21.15.129:6790/0 conn(0x7fdbcc1368f0 legacy=0x7fdbcc138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 shutdown_connections 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 --2- 172.21.15.129:0/3356526525 >> v2:172.21.15.129:6790/0 conn(0x7fdbcc062290 0x7fdbcc0619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 >> 172.21.15.129:0/3356526525 conn(0x7fdbcc05e050 msgr2=0x7fdbcc0a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 shutdown_connections 2020-01-26T15:24:12.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.102+0000 7fdbd3a00700 1 -- 172.21.15.129:0/3356526525 wait complete. 2020-01-26T15:24:12.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.3 2020-01-26T15:24:12.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:24:12.116 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.218+0000 7f09b8352700 1 Processor -- start 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.218+0000 7f09b8352700 1 -- start start 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.218+0000 7f09b8352700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00a5b80 con 0x7f09b0146c30 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.218+0000 7f09b8352700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0080440 con 0x7f09b014a880 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.218+0000 7f09b8352700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00a4e00 con 0x7f09b00a5750 2020-01-26T15:24:12.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b70f0700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f09b014a880 0x7f09b014ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47424/0 (socket says 172.21.15.129:47424) 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b68ef700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f09b00a5750 0x7f09b00a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45038/0 (socket says 172.21.15.129:45038) 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b70f0700 1 -- 172.21.15.129:0/1670287880 learned_addr learned my addr 172.21.15.129:0/1670287880 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403232303 0 0) 0x7f09b00a4e00 con 0x7f09b00a5750 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f099c003230 con 0x7f09b00a5750 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349829436 0 0) 0x7f09b0080440 con 0x7f09b014a880 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b00a4e00 con 0x7f09b014a880 2020-01-26T15:24:12.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860729727 0 0) 0x7f09b00a5b80 con 0x7f09b0146c30 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b0080440 con 0x7f09b0146c30 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 745582728 0 0) 0x7f099c003230 con 0x7f09b00a5750 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 >> v1:172.21.15.129:6790/0 conn(0x7f09b014a880 legacy=0x7f09b014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 >> v1:172.21.15.129:6789/0 conn(0x7f09b0146c30 legacy=0x7f09b0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00a3210 con 0x7f09b00a5750 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f09ac001990 con 0x7f09b00a5750 2020-01-26T15:24:12.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f09ac001d00 con 0x7f09b00a5750 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b58ed700 1 -- 172.21.15.129:0/1670287880 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f09ac004870 con 0x7f09b00a5750 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b8352700 1 -- 172.21.15.129:0/1670287880 >> v1:172.21.15.129:6791/0 conn(0x7f09b00a5750 legacy=0x7f09b00a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b8352700 1 -- 172.21.15.129:0/1670287880 shutdown_connections 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b8352700 1 -- 172.21.15.129:0/1670287880 >> 172.21.15.129:0/1670287880 conn(0x7f09b005e050 msgr2=0x7f09b0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b8352700 1 -- 172.21.15.129:0/1670287880 shutdown_connections 2020-01-26T15:24:12.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.222+0000 7f09b8352700 1 -- 172.21.15.129:0/1670287880 wait complete. 2020-01-26T15:24:12.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 Processor -- start 2020-01-26T15:24:12.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- start start 2020-01-26T15:24:12.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 0x7f09b0062d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:12.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b0131000 con 0x7f09b01303d0 2020-01-26T15:24:12.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b00632a0 con 0x7f09b0133990 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f09b00634d0 con 0x7f09b00606d0 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b68ef700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 0x7f09b0062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b68ef700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 0x7f09b0062d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b70f0700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f09b0133990 0x7f09b0133dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45046/0 (socket says 172.21.15.129:45046) 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b70f0700 1 -- 172.21.15.129:0/1255536468 learned_addr learned my addr 172.21.15.129:0/1255536468 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724558522 0 0) 0x7f09b0131000 con 0x7f09b01303d0 2020-01-26T15:24:12.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0998003230 con 0x7f09b01303d0 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913202156 0 0) 0x7f09b00632a0 con 0x7f09b0133990 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09b0131000 con 0x7f09b0133990 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2384681825 0 0) 0x7f0998003230 con 0x7f09b01303d0 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09b00632a0 con 0x7f09b01303d0 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f09a0002740 con 0x7f09b01303d0 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2087140710 0 0) 0x7f09b0131000 con 0x7f09b0133990 2020-01-26T15:24:12.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0998003230 con 0x7f09b0133990 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f09a8001710 con 0x7f09b0133990 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3363816175 0 0) 0x7f09b00632a0 con 0x7f09b01303d0 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 msgr2=0x7f09b0062d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 --2- 172.21.15.129:0/1255536468 >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 0x7f09b0062d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 >> v1:172.21.15.129:6791/0 conn(0x7f09b0133990 legacy=0x7f09b0133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b01345c0 con 0x7f09b01303d0 2020-01-26T15:24:12.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b013c0c0 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b013c3f0 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f09a0001040 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.226+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f09a0001430 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.230+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f09a0001630 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.230+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c003360 con 0x7f09b01303d0 2020-01-26T15:24:12.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.230+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f09a0049040 con 0x7f09b01303d0 2020-01-26T15:24:12.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.234+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f09a002e7c0 con 0x7f09b01303d0 2020-01-26T15:24:12.347 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.342+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 --> v1:172.21.15.129:6800/16899 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f098c0021c0 con 0x7f099803e4a0 2020-01-26T15:24:12.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09a77fe700 1 -- 172.21.15.129:0/1255536468 <== mgr.44103 v1:172.21.15.129:6800/16899 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63245 (unknown 2965378022 0 628565083) 0x7f098c0021c0 con 0x7f099803e4a0 2020-01-26T15:24:12.353 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:12.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 >> v1:172.21.15.129:6800/16899 conn(0x7f099803e4a0 legacy=0x7f09980409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 >> v1:172.21.15.129:6789/0 conn(0x7f09b01303d0 legacy=0x7f09b0130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 shutdown_connections 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 --2- 172.21.15.129:0/1255536468 >> v2:172.21.15.129:6790/0 conn(0x7f09b00606d0 0x7f09b0062d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 >> 172.21.15.129:0/1255536468 conn(0x7f09b005f4e0 msgr2=0x7f09b00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 shutdown_connections 2020-01-26T15:24:12.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.350+0000 7f09b8352700 1 -- 172.21.15.129:0/1255536468 wait complete. 2020-01-26T15:24:12.356 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:24:12.372 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2020-01-26T15:24:10.632369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4196864,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290496,"statfs":{"total":386547056640,"available":382249467904,"internally_reserved":0,"allocated":2555904,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.980765"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273831+0000","last_change":"2020-01-26T15:21:44.200448+0000","last_active":"2020-01-26T15:21:53.273831+0000","last_peered":"2020-01-26T15:21:53.273831+0000","last_clean":"2020-01-26T15:21:53.273831+0000","last_became_active":"2020-01-26T15:21:44.200120+0000","last_became_peered":"2020-01-26T15:21:44.200120+0000","last_unstale":"2020-01-26T15:21:53.273831+0000","last_undegraded":"2020-01-26T15:21:53.273831+0000","last_fullsized":"2020-01-26T15:21:53.273831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272896+0000","last_change":"2020-01-26T15:21:41.930393+0000","last_active":"2020-01-26T15:21:53.272896+0000","last_peered":"2020-01-26T15:21:53.272896+0000","last_clean":"2020-01-26T15:21:53.272896+0000","last_became_active":"2020-01-26T15:21:41.930041+0000","last_became_peered":"2020-01-26T15:21:41.930041+0000","last_unstale":"2020-01-26T15:21:53.272896+0000","last_undegraded":"2020-01-26T15:21:53.272896+0000","last_fullsized":"2020-01-26T15:21:53.272896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'5","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:22:00.772639+0000","last_change":"2020-01-26T15:21:43.942360+0000","last_active":"2020-01-26T15:22:00.772639+0000","last_peered":"2020-01-26T15:22:00.772639+0000","last_clean":"2020-01-26T15:22:00.772639+0000","last_became_active":"2020-01-26T15:21:43.941956+0000","last_became_peered":"2020-01-26T15:21:43.941956+0000","last_unstale":"2020-01-26T15:22:00.772639+0000","last_undegraded":"2020-01-26T15:22:00.772639+0000","last_fullsized":"2020-01-26T15:22:00.772639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273255+0000","last_change":"2020-01-26T15:21:44.200933+0000","last_active":"2020-01-26T15:21:53.273255+0000","last_peered":"2020-01-26T15:21:53.273255+0000","last_clean":"2020-01-26T15:21:53.273255+0000","last_became_active":"2020-01-26T15:21:44.200601+0000","last_became_peered":"2020-01-26T15:21:44.200601+0000","last_unstale":"2020-01-26T15:21:53.273255+0000","last_undegraded":"2020-01-26T15:21:53.273255+0000","last_fullsized":"2020-01-26T15:21:53.273255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273774+0000","last_change":"2020-01-26T15:21:41.924886+0000","last_active":"2020-01-26T15:21:53.273774+0000","last_peered":"2020-01-26T15:21:53.273774+0000","last_clean":"2020-01-26T15:21:53.273774+0000","last_became_active":"2020-01-26T15:21:41.924413+0000","last_became_peered":"2020-01-26T15:21:41.924413+0000","last_unstale":"2020-01-26T15:21:53.273774+0000","last_undegraded":"2020-01-26T15:21:53.273774+0000","last_fullsized":"2020-01-26T15:21:53.273774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274720+0000","last_change":"2020-01-26T15:21:43.943474+0000","last_active":"2020-01-26T15:21:53.274720+0000","last_peered":"2020-01-26T15:21:53.274720+0000","last_clean":"2020-01-26T15:21:53.274720+0000","last_became_active":"2020-01-26T15:21:43.943083+0000","last_became_peered":"2020-01-26T15:21:43.943083+0000","last_unstale":"2020-01-26T15:21:53.274720+0000","last_undegraded":"2020-01-26T15:21:53.274720+0000","last_fullsized":"2020-01-26T15:21:53.274720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273065+0000","last_change":"2020-01-26T15:21:44.197335+0000","last_active":"2020-01-26T15:21:53.273065+0000","last_peered":"2020-01-26T15:21:53.273065+0000","last_clean":"2020-01-26T15:21:53.273065+0000","last_became_active":"2020-01-26T15:21:44.196982+0000","last_became_peered":"2020-01-26T15:21:44.196982+0000","last_unstale":"2020-01-26T15:21:53.273065+0000","last_undegraded":"2020-01-26T15:21:53.273065+0000","last_fullsized":"2020-01-26T15:21:53.273065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224120+0000","last_change":"2020-01-26T15:21:41.928416+0000","last_active":"2020-01-26T15:21:52.224120+0000","last_peered":"2020-01-26T15:21:52.224120+0000","last_clean":"2020-01-26T15:21:52.224120+0000","last_became_active":"2020-01-26T15:21:41.928076+0000","last_became_peered":"2020-01-26T15:21:41.928076+0000","last_unstale":"2020-01-26T15:21:52.224120+0000","last_undegraded":"2020-01-26T15:21:52.224120+0000","last_fullsized":"2020-01-26T15:21:52.224120+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"20","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273844+0000","last_change":"2020-01-26T15:21:43.941003+0000","last_active":"2020-01-26T15:21:53.273844+0000","last_peered":"2020-01-26T15:21:53.273844+0000","last_clean":"2020-01-26T15:21:53.273844+0000","last_became_active":"2020-01-26T15:21:43.940619+0000","last_became_peered":"2020-01-26T15:21:43.940619+0000","last_unstale":"2020-01-26T15:21:53.273844+0000","last_undegraded":"2020-01-26T15:21:53.273844+0000","last_fullsized":"2020-01-26T15:21:53.273844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224078+0000","last_change":"2020-01-26T15:21:44.200325+0000","last_active":"2020-01-26T15:21:52.224078+0000","last_peered":"2020-01-26T15:21:52.224078+0000","last_clean":"2020-01-26T15:21:52.224078+0000","last_became_active":"2020-01-26T15:21:44.199937+0000","last_became_peered":"2020-01-26T15:21:44.199937+0000","last_unstale":"2020-01-26T15:21:52.224078+0000","last_undegraded":"2020-01-26T15:21:52.224078+0000","last_fullsized":"2020-01-26T15:21:52.224078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273280+0000","last_change":"2020-01-26T15:21:41.927799+0000","last_active":"2020-01-26T15:21:53.273280+0000","last_peered":"2020-01-26T15:21:53.273280+0000","last_clean":"2020-01-26T15:21:53.273280+0000","last_became_active":"2020-01-26T15:21:41.927403+0000","last_became_peered":"2020-01-26T15:21:41.927403+0000","last_unstale":"2020-01-26T15:21:53.273280+0000","last_undegraded":"2020-01-26T15:21:53.273280+0000","last_fullsized":"2020-01-26T15:21:53.273280+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272719+0000","last_change":"2020-01-26T15:21:43.939282+0000","last_active":"2020-01-26T15:21:53.272719+0000","last_peered":"2020-01-26T15:21:53.272719+0000","last_clean":"2020-01-26T15:21:53.272719+0000","last_became_active":"2020-01-26T15:21:43.938954+0000","last_became_peered":"2020-01-26T15:21:43.938954+0000","last_unstale":"2020-01-26T15:21:53.272719+0000","last_undegraded":"2020-01-26T15:21:53.272719+0000","last_fullsized":"2020-01-26T15:21:53.272719+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273833+0000","last_change":"2020-01-26T15:21:44.201926+0000","last_active":"2020-01-26T15:21:53.273833+0000","last_peered":"2020-01-26T15:21:53.273833+0000","last_clean":"2020-01-26T15:21:53.273833+0000","last_became_active":"2020-01-26T15:21:44.201594+0000","last_became_peered":"2020-01-26T15:21:44.201594+0000","last_unstale":"2020-01-26T15:21:53.273833+0000","last_undegraded":"2020-01-26T15:21:53.273833+0000","last_fullsized":"2020-01-26T15:21:53.273833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224001+0000","last_change":"2020-01-26T15:21:41.925677+0000","last_active":"2020-01-26T15:21:52.224001+0000","last_peered":"2020-01-26T15:21:52.224001+0000","last_clean":"2020-01-26T15:21:52.224001+0000","last_became_active":"2020-01-26T15:21:41.925120+0000","last_became_peered":"2020-01-26T15:21:41.925120+0000","last_unstale":"2020-01-26T15:21:52.224001+0000","last_undegraded":"2020-01-26T15:21:52.224001+0000","last_fullsized":"2020-01-26T15:21:52.224001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273979+0000","last_change":"2020-01-26T15:21:43.943006+0000","last_active":"2020-01-26T15:21:53.273979+0000","last_peered":"2020-01-26T15:21:53.273979+0000","last_clean":"2020-01-26T15:21:53.273979+0000","last_became_active":"2020-01-26T15:21:43.941028+0000","last_became_peered":"2020-01-26T15:21:43.941028+0000","last_unstale":"2020-01-26T15:21:53.273979+0000","last_undegraded":"2020-01-26T15:21:53.273979+0000","last_fullsized":"2020-01-26T15:21:53.273979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273076+0000","last_change":"2020-01-26T15:21:44.197371+0000","last_active":"2020-01-26T15:21:53.273076+0000","last_peered":"2020-01-26T15:21:53.273076+0000","last_clean":"2020-01-26T15:21:53.273076+0000","last_became_active":"2020-01-26T15:21:44.197041+0000","last_became_peered":"2020-01-26T15:21:44.197041+0000","last_unstale":"2020-01-26T15:21:53.273076+0000","last_undegraded":"2020-01-26T15:21:53.273076+0000","last_fullsized":"2020-01-26T15:21:53.273076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273719+0000","last_change":"2020-01-26T15:21:41.924864+0000","last_active":"2020-01-26T15:21:53.273719+0000","last_peered":"2020-01-26T15:21:53.273719+0000","last_clean":"2020-01-26T15:21:53.273719+0000","last_became_active":"2020-01-26T15:21:41.924454+0000","last_became_peered":"2020-01-26T15:21:41.924454+0000","last_unstale":"2020-01-26T15:21:53.273719+0000","last_undegraded":"2020-01-26T15:21:53.273719+0000","last_fullsized":"2020-01-26T15:21:53.273719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274083+0000","last_change":"2020-01-26T15:21:43.939847+0000","last_active":"2020-01-26T15:21:53.274083+0000","last_peered":"2020-01-26T15:21:53.274083+0000","last_clean":"2020-01-26T15:21:53.274083+0000","last_became_active":"2020-01-26T15:21:43.939484+0000","last_became_peered":"2020-01-26T15:21:43.939484+0000","last_unstale":"2020-01-26T15:21:53.274083+0000","last_undegraded":"2020-01-26T15:21:53.274083+0000","last_fullsized":"2020-01-26T15:21:53.274083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224227+0000","last_change":"2020-01-26T15:21:44.202021+0000","last_active":"2020-01-26T15:21:52.224227+0000","last_peered":"2020-01-26T15:21:52.224227+0000","last_clean":"2020-01-26T15:21:52.224227+0000","last_became_active":"2020-01-26T15:21:44.201689+0000","last_became_peered":"2020-01-26T15:21:44.201689+0000","last_unstale":"2020-01-26T15:21:52.224227+0000","last_undegraded":"2020-01-26T15:21:52.224227+0000","last_fullsized":"2020-01-26T15:21:52.224227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273778+0000","last_change":"2020-01-26T15:21:41.928224+0000","last_active":"2020-01-26T15:21:53.273778+0000","last_peered":"2020-01-26T15:21:53.273778+0000","last_clean":"2020-01-26T15:21:53.273778+0000","last_became_active":"2020-01-26T15:21:41.927618+0000","last_became_peered":"2020-01-26T15:21:41.927618+0000","last_unstale":"2020-01-26T15:21:53.273778+0000","last_undegraded":"2020-01-26T15:21:53.273778+0000","last_fullsized":"2020-01-26T15:21:53.273778+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"18","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274209+0000","last_change":"2020-01-26T15:21:43.943353+0000","last_active":"2020-01-26T15:21:53.274209+0000","last_peered":"2020-01-26T15:21:53.274209+0000","last_clean":"2020-01-26T15:21:53.274209+0000","last_became_active":"2020-01-26T15:21:43.942956+0000","last_became_peered":"2020-01-26T15:21:43.942956+0000","last_unstale":"2020-01-26T15:21:53.274209+0000","last_undegraded":"2020-01-26T15:21:53.274209+0000","last_fullsized":"2020-01-26T15:21:53.274209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272826+0000","last_change":"2020-01-26T15:21:44.203122+0000","last_active":"2020-01-26T15:21:53.272826+0000","last_peered":"2020-01-26T15:21:53.272826+0000","last_clean":"2020-01-26T15:21:53.272826+0000","last_became_active":"2020-01-26T15:21:44.202380+0000","last_became_peered":"2020-01-26T15:21:44.202380+0000","last_unstale":"2020-01-26T15:21:53.272826+0000","last_undegraded":"2020-01-26T15:21:53.272826+0000","last_fullsized":"2020-01-26T15:21:53.272826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224363+0000","last_change":"2020-01-26T15:21:41.928890+0000","last_active":"2020-01-26T15:21:52.224363+0000","last_peered":"2020-01-26T15:21:52.224363+0000","last_clean":"2020-01-26T15:21:52.224363+0000","last_became_active":"2020-01-26T15:21:41.927480+0000","last_became_peered":"2020-01-26T15:21:41.927480+0000","last_unstale":"2020-01-26T15:21:52.224363+0000","last_undegraded":"2020-01-26T15:21:52.224363+0000","last_fullsized":"2020-01-26T15:21:52.224363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'14","reported_seq":"26","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:24:08.684182+0000","last_change":"2020-01-26T15:21:43.942785+0000","last_active":"2020-01-26T15:24:08.684182+0000","last_peered":"2020-01-26T15:24:08.684182+0000","last_clean":"2020-01-26T15:24:08.684182+0000","last_became_active":"2020-01-26T15:21:43.942416+0000","last_became_peered":"2020-01-26T15:21:43.942416+0000","last_unstale":"2020-01-26T15:24:08.684182+0000","last_undegraded":"2020-01-26T15:24:08.684182+0000","last_fullsized":"2020-01-26T15:24:08.684182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705699,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"statfs":{"total":96636764160,"available":95562350592,"internally_reserved":0,"allocated":655360,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705699,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":0,"allocated":589824,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049264,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322576,"statfs":{"total":96636764160,"available":95562317824,"internally_reserved":0,"allocated":688128,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"statfs":{"total":96636764160,"available":95562383360,"internally_reserved":0,"allocated":622592,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:24:12.375 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:24:12.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 Processor -- start 2020-01-26T15:24:12.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 -- start start 2020-01-26T15:24:12.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829805ea20 con 0x7f82980a6870 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8298098000 con 0x7f829805edd0 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829805e050 con 0x7f829805e5f0 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8296d9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f829805edd0 0x7f829807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47436/0 (socket says 172.21.15.129:47436) 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8296d9d700 1 -- 172.21.15.129:0/1574432415 learned_addr learned my addr 172.21.15.129:0/1574432415 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148363489 0 0) 0x7f829805e050 con 0x7f829805e5f0 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8278003230 con 0x7f829805e5f0 2020-01-26T15:24:12.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855008118 0 0) 0x7f8298098000 con 0x7f829805edd0 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f829805e050 con 0x7f829805edd0 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938600259 0 0) 0x7f829805ea20 con 0x7f82980a6870 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8298098000 con 0x7f82980a6870 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4240684924 0 0) 0x7f829805e050 con 0x7f829805edd0 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 >> v1:172.21.15.129:6791/0 conn(0x7f829805e5f0 legacy=0x7f8298149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 >> v1:172.21.15.129:6789/0 conn(0x7f82980a6870 legacy=0x7f829814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980a6ca0 con 0x7f829805edd0 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f82900015f0 con 0x7f829805edd0 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8290001960 con 0x7f829805edd0 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f8295d9b700 1 -- 172.21.15.129:0/1574432415 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f82900045b0 con 0x7f829805edd0 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.486+0000 7f829759e700 1 -- 172.21.15.129:0/1574432415 >> v1:172.21.15.129:6790/0 conn(0x7f829805edd0 legacy=0x7f829807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- 172.21.15.129:0/1574432415 shutdown_connections 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- 172.21.15.129:0/1574432415 >> 172.21.15.129:0/1574432415 conn(0x7f8298098e70 msgr2=0x7f82980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- 172.21.15.129:0/1574432415 shutdown_connections 2020-01-26T15:24:12.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- 172.21.15.129:0/1574432415 wait complete. 2020-01-26T15:24:12.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 Processor -- start 2020-01-26T15:24:12.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- start start 2020-01-26T15:24:12.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 0x7f82980a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 0x7f829815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829809e910 con 0x7f829809e150 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f82980a35c0 con 0x7f82980a3860 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829759e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8298024cf0 con 0x7f82980a18d0 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829659c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 0x7f82980a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:12.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829659c700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 0x7f82980a1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f8296d9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f829809e150 0x7f829807d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45058/0 (socket says 172.21.15.129:45058) 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f8296d9d700 1 -- 172.21.15.129:0/3648936837 learned_addr learned my addr 172.21.15.129:0/3648936837 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829c823700 -1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 0x7f829815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f829c823700 1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 0x7f829815c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.490+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276341506 0 0) 0x7f829809e910 con 0x7f829809e150 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8270003230 con 0x7f829809e150 2020-01-26T15:24:12.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3630420268 0 0) 0x7f8270003230 con 0x7f829809e150 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f829809e910 con 0x7f829809e150 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8290001b80 con 0x7f829809e150 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3907889482 0 0) 0x7f829809e910 con 0x7f829809e150 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 msgr2=0x7f829815c9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 0x7f829815c9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 msgr2=0x7f82980a1380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 0x7f82980a1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298141eb0 con 0x7f829809e150 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82980a31a0 con 0x7f829809e150 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f829815d0e0 con 0x7f829809e150 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8290004990 con 0x7f829809e150 2020-01-26T15:24:12.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8290004dc0 con 0x7f829809e150 2020-01-26T15:24:12.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8298056600 con 0x7f829809e150 2020-01-26T15:24:12.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f8290005ff0 con 0x7f829809e150 2020-01-26T15:24:12.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.494+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f829004b9c0 con 0x7f829809e150 2020-01-26T15:24:12.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.498+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f82900311c0 con 0x7f829809e150 2020-01-26T15:24:12.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.610+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 --> v1:172.21.15.129:6800/16899 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f829809f010 con 0x7f827003dfd0 2020-01-26T15:24:12.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f828f7fe700 1 -- 172.21.15.129:0/3648936837 <== mgr.44103 v1:172.21.15.129:6800/16899 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63245 (unknown 2965378022 0 628565083) 0x7f829809f010 con 0x7f827003dfd0 2020-01-26T15:24:12.618 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 >> v1:172.21.15.129:6800/16899 conn(0x7f827003dfd0 legacy=0x7f82700404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 >> v1:172.21.15.129:6791/0 conn(0x7f829809e150 legacy=0x7f829807d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 shutdown_connections 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6791/0 conn(0x7f82980a18d0 0x7f829815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 --2- 172.21.15.129:0/3648936837 >> v2:172.21.15.129:6790/0 conn(0x7f82980a3860 0x7f82980a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 >> 172.21.15.129:0/3648936837 conn(0x7f8298024f00 msgr2=0x7f8298145ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 shutdown_connections 2020-01-26T15:24:12.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.614+0000 7f829759e700 1 -- 172.21.15.129:0/3648936837 wait complete. 2020-01-26T15:24:12.620 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:24:12.630 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2020-01-26T15:24:10.632369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4196864,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373290496,"statfs":{"total":386547056640,"available":382249467904,"internally_reserved":0,"allocated":2555904,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.980765"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273831+0000","last_change":"2020-01-26T15:21:44.200448+0000","last_active":"2020-01-26T15:21:53.273831+0000","last_peered":"2020-01-26T15:21:53.273831+0000","last_clean":"2020-01-26T15:21:53.273831+0000","last_became_active":"2020-01-26T15:21:44.200120+0000","last_became_peered":"2020-01-26T15:21:44.200120+0000","last_unstale":"2020-01-26T15:21:53.273831+0000","last_undegraded":"2020-01-26T15:21:53.273831+0000","last_fullsized":"2020-01-26T15:21:53.273831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272896+0000","last_change":"2020-01-26T15:21:41.930393+0000","last_active":"2020-01-26T15:21:53.272896+0000","last_peered":"2020-01-26T15:21:53.272896+0000","last_clean":"2020-01-26T15:21:53.272896+0000","last_became_active":"2020-01-26T15:21:41.930041+0000","last_became_peered":"2020-01-26T15:21:41.930041+0000","last_unstale":"2020-01-26T15:21:53.272896+0000","last_undegraded":"2020-01-26T15:21:53.272896+0000","last_fullsized":"2020-01-26T15:21:53.272896+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'5","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:22:00.772639+0000","last_change":"2020-01-26T15:21:43.942360+0000","last_active":"2020-01-26T15:22:00.772639+0000","last_peered":"2020-01-26T15:22:00.772639+0000","last_clean":"2020-01-26T15:22:00.772639+0000","last_became_active":"2020-01-26T15:21:43.941956+0000","last_became_peered":"2020-01-26T15:21:43.941956+0000","last_unstale":"2020-01-26T15:22:00.772639+0000","last_undegraded":"2020-01-26T15:22:00.772639+0000","last_fullsized":"2020-01-26T15:22:00.772639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273255+0000","last_change":"2020-01-26T15:21:44.200933+0000","last_active":"2020-01-26T15:21:53.273255+0000","last_peered":"2020-01-26T15:21:53.273255+0000","last_clean":"2020-01-26T15:21:53.273255+0000","last_became_active":"2020-01-26T15:21:44.200601+0000","last_became_peered":"2020-01-26T15:21:44.200601+0000","last_unstale":"2020-01-26T15:21:53.273255+0000","last_undegraded":"2020-01-26T15:21:53.273255+0000","last_fullsized":"2020-01-26T15:21:53.273255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273774+0000","last_change":"2020-01-26T15:21:41.924886+0000","last_active":"2020-01-26T15:21:53.273774+0000","last_peered":"2020-01-26T15:21:53.273774+0000","last_clean":"2020-01-26T15:21:53.273774+0000","last_became_active":"2020-01-26T15:21:41.924413+0000","last_became_peered":"2020-01-26T15:21:41.924413+0000","last_unstale":"2020-01-26T15:21:53.273774+0000","last_undegraded":"2020-01-26T15:21:53.273774+0000","last_fullsized":"2020-01-26T15:21:53.273774+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"19","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274720+0000","last_change":"2020-01-26T15:21:43.943474+0000","last_active":"2020-01-26T15:21:53.274720+0000","last_peered":"2020-01-26T15:21:53.274720+0000","last_clean":"2020-01-26T15:21:53.274720+0000","last_became_active":"2020-01-26T15:21:43.943083+0000","last_became_peered":"2020-01-26T15:21:43.943083+0000","last_unstale":"2020-01-26T15:21:53.274720+0000","last_undegraded":"2020-01-26T15:21:53.274720+0000","last_fullsized":"2020-01-26T15:21:53.274720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273065+0000","last_change":"2020-01-26T15:21:44.197335+0000","last_active":"2020-01-26T15:21:53.273065+0000","last_peered":"2020-01-26T15:21:53.273065+0000","last_clean":"2020-01-26T15:21:53.273065+0000","last_became_active":"2020-01-26T15:21:44.196982+0000","last_became_peered":"2020-01-26T15:21:44.196982+0000","last_unstale":"2020-01-26T15:21:53.273065+0000","last_undegraded":"2020-01-26T15:21:53.273065+0000","last_fullsized":"2020-01-26T15:21:53.273065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224120+0000","last_change":"2020-01-26T15:21:41.928416+0000","last_active":"2020-01-26T15:21:52.224120+0000","last_peered":"2020-01-26T15:21:52.224120+0000","last_clean":"2020-01-26T15:21:52.224120+0000","last_became_active":"2020-01-26T15:21:41.928076+0000","last_became_peered":"2020-01-26T15:21:41.928076+0000","last_unstale":"2020-01-26T15:21:52.224120+0000","last_undegraded":"2020-01-26T15:21:52.224120+0000","last_fullsized":"2020-01-26T15:21:52.224120+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"20","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273844+0000","last_change":"2020-01-26T15:21:43.941003+0000","last_active":"2020-01-26T15:21:53.273844+0000","last_peered":"2020-01-26T15:21:53.273844+0000","last_clean":"2020-01-26T15:21:53.273844+0000","last_became_active":"2020-01-26T15:21:43.940619+0000","last_became_peered":"2020-01-26T15:21:43.940619+0000","last_unstale":"2020-01-26T15:21:53.273844+0000","last_undegraded":"2020-01-26T15:21:53.273844+0000","last_fullsized":"2020-01-26T15:21:53.273844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224078+0000","last_change":"2020-01-26T15:21:44.200325+0000","last_active":"2020-01-26T15:21:52.224078+0000","last_peered":"2020-01-26T15:21:52.224078+0000","last_clean":"2020-01-26T15:21:52.224078+0000","last_became_active":"2020-01-26T15:21:44.199937+0000","last_became_peered":"2020-01-26T15:21:44.199937+0000","last_unstale":"2020-01-26T15:21:52.224078+0000","last_undegraded":"2020-01-26T15:21:52.224078+0000","last_fullsized":"2020-01-26T15:21:52.224078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273280+0000","last_change":"2020-01-26T15:21:41.927799+0000","last_active":"2020-01-26T15:21:53.273280+0000","last_peered":"2020-01-26T15:21:53.273280+0000","last_clean":"2020-01-26T15:21:53.273280+0000","last_became_active":"2020-01-26T15:21:41.927403+0000","last_became_peered":"2020-01-26T15:21:41.927403+0000","last_unstale":"2020-01-26T15:21:53.273280+0000","last_undegraded":"2020-01-26T15:21:53.273280+0000","last_fullsized":"2020-01-26T15:21:53.273280+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272719+0000","last_change":"2020-01-26T15:21:43.939282+0000","last_active":"2020-01-26T15:21:53.272719+0000","last_peered":"2020-01-26T15:21:53.272719+0000","last_clean":"2020-01-26T15:21:53.272719+0000","last_became_active":"2020-01-26T15:21:43.938954+0000","last_became_peered":"2020-01-26T15:21:43.938954+0000","last_unstale":"2020-01-26T15:21:53.272719+0000","last_undegraded":"2020-01-26T15:21:53.272719+0000","last_fullsized":"2020-01-26T15:21:53.272719+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273833+0000","last_change":"2020-01-26T15:21:44.201926+0000","last_active":"2020-01-26T15:21:53.273833+0000","last_peered":"2020-01-26T15:21:53.273833+0000","last_clean":"2020-01-26T15:21:53.273833+0000","last_became_active":"2020-01-26T15:21:44.201594+0000","last_became_peered":"2020-01-26T15:21:44.201594+0000","last_unstale":"2020-01-26T15:21:53.273833+0000","last_undegraded":"2020-01-26T15:21:53.273833+0000","last_fullsized":"2020-01-26T15:21:53.273833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224001+0000","last_change":"2020-01-26T15:21:41.925677+0000","last_active":"2020-01-26T15:21:52.224001+0000","last_peered":"2020-01-26T15:21:52.224001+0000","last_clean":"2020-01-26T15:21:52.224001+0000","last_became_active":"2020-01-26T15:21:41.925120+0000","last_became_peered":"2020-01-26T15:21:41.925120+0000","last_unstale":"2020-01-26T15:21:52.224001+0000","last_undegraded":"2020-01-26T15:21:52.224001+0000","last_fullsized":"2020-01-26T15:21:52.224001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"17","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273979+0000","last_change":"2020-01-26T15:21:43.943006+0000","last_active":"2020-01-26T15:21:53.273979+0000","last_peered":"2020-01-26T15:21:53.273979+0000","last_clean":"2020-01-26T15:21:53.273979+0000","last_became_active":"2020-01-26T15:21:43.941028+0000","last_became_peered":"2020-01-26T15:21:43.941028+0000","last_unstale":"2020-01-26T15:21:53.273979+0000","last_undegraded":"2020-01-26T15:21:53.273979+0000","last_fullsized":"2020-01-26T15:21:53.273979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273076+0000","last_change":"2020-01-26T15:21:44.197371+0000","last_active":"2020-01-26T15:21:53.273076+0000","last_peered":"2020-01-26T15:21:53.273076+0000","last_clean":"2020-01-26T15:21:53.273076+0000","last_became_active":"2020-01-26T15:21:44.197041+0000","last_became_peered":"2020-01-26T15:21:44.197041+0000","last_unstale":"2020-01-26T15:21:53.273076+0000","last_undegraded":"2020-01-26T15:21:53.273076+0000","last_fullsized":"2020-01-26T15:21:53.273076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273719+0000","last_change":"2020-01-26T15:21:41.924864+0000","last_active":"2020-01-26T15:21:53.273719+0000","last_peered":"2020-01-26T15:21:53.273719+0000","last_clean":"2020-01-26T15:21:53.273719+0000","last_became_active":"2020-01-26T15:21:41.924454+0000","last_became_peered":"2020-01-26T15:21:41.924454+0000","last_unstale":"2020-01-26T15:21:53.273719+0000","last_undegraded":"2020-01-26T15:21:53.273719+0000","last_fullsized":"2020-01-26T15:21:53.273719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274083+0000","last_change":"2020-01-26T15:21:43.939847+0000","last_active":"2020-01-26T15:21:53.274083+0000","last_peered":"2020-01-26T15:21:53.274083+0000","last_clean":"2020-01-26T15:21:53.274083+0000","last_became_active":"2020-01-26T15:21:43.939484+0000","last_became_peered":"2020-01-26T15:21:43.939484+0000","last_unstale":"2020-01-26T15:21:53.274083+0000","last_undegraded":"2020-01-26T15:21:53.274083+0000","last_fullsized":"2020-01-26T15:21:53.274083+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224227+0000","last_change":"2020-01-26T15:21:44.202021+0000","last_active":"2020-01-26T15:21:52.224227+0000","last_peered":"2020-01-26T15:21:52.224227+0000","last_clean":"2020-01-26T15:21:52.224227+0000","last_became_active":"2020-01-26T15:21:44.201689+0000","last_became_peered":"2020-01-26T15:21:44.201689+0000","last_unstale":"2020-01-26T15:21:52.224227+0000","last_undegraded":"2020-01-26T15:21:52.224227+0000","last_fullsized":"2020-01-26T15:21:52.224227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.273778+0000","last_change":"2020-01-26T15:21:41.928224+0000","last_active":"2020-01-26T15:21:53.273778+0000","last_peered":"2020-01-26T15:21:53.273778+0000","last_clean":"2020-01-26T15:21:53.273778+0000","last_became_active":"2020-01-26T15:21:41.927618+0000","last_became_peered":"2020-01-26T15:21:41.927618+0000","last_unstale":"2020-01-26T15:21:53.273778+0000","last_undegraded":"2020-01-26T15:21:53.273778+0000","last_fullsized":"2020-01-26T15:21:53.273778+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"18","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.274209+0000","last_change":"2020-01-26T15:21:43.943353+0000","last_active":"2020-01-26T15:21:53.274209+0000","last_peered":"2020-01-26T15:21:53.274209+0000","last_clean":"2020-01-26T15:21:53.274209+0000","last_became_active":"2020-01-26T15:21:43.942956+0000","last_became_peered":"2020-01-26T15:21:43.942956+0000","last_unstale":"2020-01-26T15:21:53.274209+0000","last_undegraded":"2020-01-26T15:21:53.274209+0000","last_fullsized":"2020-01-26T15:21:53.274209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:53.272826+0000","last_change":"2020-01-26T15:21:44.203122+0000","last_active":"2020-01-26T15:21:53.272826+0000","last_peered":"2020-01-26T15:21:53.272826+0000","last_clean":"2020-01-26T15:21:53.272826+0000","last_became_active":"2020-01-26T15:21:44.202380+0000","last_became_peered":"2020-01-26T15:21:44.202380+0000","last_unstale":"2020-01-26T15:21:53.272826+0000","last_undegraded":"2020-01-26T15:21:53.272826+0000","last_fullsized":"2020-01-26T15:21:53.272826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2020-01-26T15:21:52.224363+0000","last_change":"2020-01-26T15:21:41.928890+0000","last_active":"2020-01-26T15:21:52.224363+0000","last_peered":"2020-01-26T15:21:52.224363+0000","last_clean":"2020-01-26T15:21:52.224363+0000","last_became_active":"2020-01-26T15:21:41.927480+0000","last_became_peered":"2020-01-26T15:21:41.927480+0000","last_unstale":"2020-01-26T15:21:52.224363+0000","last_undegraded":"2020-01-26T15:21:52.224363+0000","last_fullsized":"2020-01-26T15:21:52.224363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'14","reported_seq":"26","reported_epoch":"17","state":"active+clean","last_fresh":"2020-01-26T15:24:08.684182+0000","last_change":"2020-01-26T15:21:43.942785+0000","last_active":"2020-01-26T15:24:08.684182+0000","last_peered":"2020-01-26T15:24:08.684182+0000","last_clean":"2020-01-26T15:24:08.684182+0000","last_became_active":"2020-01-26T15:21:43.942416+0000","last_became_peered":"2020-01-26T15:21:43.942416+0000","last_unstale":"2020-01-26T15:24:08.684182+0000","last_undegraded":"2020-01-26T15:24:08.684182+0000","last_fullsized":"2020-01-26T15:24:08.684182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705699,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049232,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322608,"statfs":{"total":96636764160,"available":95562350592,"internally_reserved":0,"allocated":655360,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705699,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":0,"allocated":589824,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049264,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322576,"statfs":{"total":96636764160,"available":95562317824,"internally_reserved":0,"allocated":688128,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049200,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"statfs":{"total":96636764160,"available":95562383360,"internally_reserved":0,"allocated":622592,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:24:12.632 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:24:12.632 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:24:12.633 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:24:12.633 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:12.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 Processor -- start 2020-01-26T15:24:12.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 -- start start 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 0x7f645414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645405ea20 con 0x7f645405edd0 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6454098000 con 0x7f645405e5f0 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f645405e050 con 0x7f64540a6870 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f64596cd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f645405edd0 0x7f645407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39150/0 (socket says 172.21.15.129:39150) 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f64596cd700 1 -- 172.21.15.129:0/2621318874 learned_addr learned my addr 172.21.15.129:0/2621318874 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.745 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f645b130700 -1 --2- 172.21.15.129:0/2621318874 >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 0x7f645414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f645b130700 1 --2- 172.21.15.129:0/2621318874 >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 0x7f645414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434298124 0 0) 0x7f6454098000 con 0x7f645405e5f0 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6440003230 con 0x7f645405e5f0 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212818417 0 0) 0x7f645405ea20 con 0x7f645405edd0 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6454098000 con 0x7f645405edd0 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3554254470 0 0) 0x7f6454098000 con 0x7f645405edd0 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 msgr2=0x7f645414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:12.746 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 --2- 172.21.15.129:0/2621318874 >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 0x7f645414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 >> v1:172.21.15.129:6790/0 conn(0x7f645405e5f0 legacy=0x7f6454149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540a6ca0 con 0x7f645405edd0 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f64480016c0 con 0x7f645405edd0 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f6448001a30 con 0x7f645405edd0 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6447fff700 1 -- 172.21.15.129:0/2621318874 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f64480045b0 con 0x7f645405edd0 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.738+0000 7f6459ece700 1 -- 172.21.15.129:0/2621318874 >> v1:172.21.15.129:6789/0 conn(0x7f645405edd0 legacy=0x7f645407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.747 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/2621318874 shutdown_connections 2020-01-26T15:24:12.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 --2- 172.21.15.129:0/2621318874 >> v2:172.21.15.129:6791/0 conn(0x7f64540a6870 0x7f645414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:12.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/2621318874 >> 172.21.15.129:0/2621318874 conn(0x7f6454098e70 msgr2=0x7f64540a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/2621318874 shutdown_connections 2020-01-26T15:24:12.748 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/2621318874 wait complete. 2020-01-26T15:24:12.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 Processor -- start 2020-01-26T15:24:12.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- start start 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 0x7f64540a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 0x7f6454130b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540a1b10 con 0x7f645412cd50 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6454121cd0 con 0x7f64540a16e0 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f645412d5b0 con 0x7f645412d180 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f64596cd700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 0x7f64540a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:12.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f64596cd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 0x7f64540a0cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f645b130700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 0x7f6454130b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6458ecc700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f645412cd50 0x7f6454130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47458/0 (socket says 172.21.15.129:47458) 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6458ecc700 1 -- 172.21.15.129:0/1736537931 learned_addr learned my addr 172.21.15.129:0/1736537931 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f645b130700 1 --2- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 0x7f6454130b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392706965 0 0) 0x7f64540a1b10 con 0x7f645412cd50 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6434003230 con 0x7f645412cd50 2020-01-26T15:24:12.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3193311261 0 0) 0x7f6434003230 con 0x7f645412cd50 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64540a1b10 con 0x7f645412cd50 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6450001900 con 0x7f645412cd50 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2412699073 0 0) 0x7f64540a1b10 con 0x7f645412cd50 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 msgr2=0x7f6454130b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 --2- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 0x7f6454130b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 msgr2=0x7f64540a0cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 --2- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 0x7f64540a0cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454131060 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64540a0400 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540a1240 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.742+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f6450002040 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.746+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6450004a60 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.746+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f6450010520 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.746+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c003360 con 0x7f645412cd50 2020-01-26T15:24:12.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.746+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f645004b9b0 con 0x7f645412cd50 2020-01-26T15:24:12.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.750+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f6450031090 con 0x7f645412cd50 2020-01-26T15:24:12.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.902+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f642c0037d0 con 0x7f645412cd50 2020-01-26T15:24:12.907 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6445ffb700 1 -- 172.21.15.129:0/1736537931 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (unknown 3730786198 0 3397129104) 0x7f645004a7e0 con 0x7f645412cd50 2020-01-26T15:24:12.908 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:12.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 >> v1:172.21.15.129:6800/16899 conn(0x7f643403e070 legacy=0x7f6434040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.910 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 >> v1:172.21.15.129:6790/0 conn(0x7f645412cd50 legacy=0x7f6454130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 shutdown_connections 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 --2- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6791/0 conn(0x7f645412d180 0x7f6454130b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 --2- 172.21.15.129:0/1736537931 >> v2:172.21.15.129:6790/0 conn(0x7f64540a16e0 0x7f64540a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 >> 172.21.15.129:0/1736537931 conn(0x7f645407f5d0 msgr2=0x7f64541222c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 shutdown_connections 2020-01-26T15:24:12.911 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:12.906+0000 7f6459ece700 1 -- 172.21.15.129:0/1736537931 wait complete. 2020-01-26T15:24:12.926 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-01-26T15:24:12.926 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-01-26T15:24:12.926 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:13.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.026+0000 7f79f71ce700 1 Processor -- start 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.026+0000 7f79f71ce700 1 -- start start 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 0x7f79f014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f005ea20 con 0x7f79f005edd0 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f0098000 con 0x7f79f005e5f0 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f79f005e050 con 0x7f79f00a6870 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f69cd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f79f005edd0 0x7f79f007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47464/0 (socket says 172.21.15.129:47464) 2020-01-26T15:24:13.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f69cd700 1 -- 172.21.15.129:0/4030108842 learned_addr learned my addr 172.21.15.129:0/4030108842 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f8430700 -1 --2- 172.21.15.129:0/4030108842 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 0x7f79f014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f8430700 1 --2- 172.21.15.129:0/4030108842 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 0x7f79f014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093542888 0 0) 0x7f79f005ea20 con 0x7f79f005edd0 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d8003230 con 0x7f79f005edd0 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016785070 0 0) 0x7f79f0098000 con 0x7f79f005e5f0 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f005ea20 con 0x7f79f005e5f0 2020-01-26T15:24:13.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4274233277 0 0) 0x7f79d8003230 con 0x7f79f005edd0 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 msgr2=0x7f79f014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 --2- 172.21.15.129:0/4030108842 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 0x7f79f014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 >> v1:172.21.15.129:6791/0 conn(0x7f79f005e5f0 legacy=0x7f79f0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00a6ca0 con 0x7f79f005edd0 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f79e0001a60 con 0x7f79f005edd0 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f79e0001dd0 con 0x7f79f005edd0 2020-01-26T15:24:13.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f59cb700 1 -- 172.21.15.129:0/4030108842 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f79e0004930 con 0x7f79f005edd0 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- 172.21.15.129:0/4030108842 >> v1:172.21.15.129:6790/0 conn(0x7f79f005edd0 legacy=0x7f79f007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- 172.21.15.129:0/4030108842 shutdown_connections 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 --2- 172.21.15.129:0/4030108842 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a6870 0x7f79f014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- 172.21.15.129:0/4030108842 >> 172.21.15.129:0/4030108842 conn(0x7f79f0098e70 msgr2=0x7f79f00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- 172.21.15.129:0/4030108842 shutdown_connections 2020-01-26T15:24:13.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.030+0000 7f79f71ce700 1 -- 172.21.15.129:0/4030108842 wait complete. 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 Processor -- start 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- start start 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 0x7f79f009e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 0x7f79f007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f007d650 con 0x7f79f00a38e0 2020-01-26T15:24:13.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00a3e50 con 0x7f79f00a2960 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00a19d0 con 0x7f79f00a24a0 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f8430700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 0x7f79f007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f69cd700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 0x7f79f009e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f8430700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 0x7f79f007d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f69cd700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 0x7f79f009e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f61cc700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f79f00a38e0 0x7f79f007c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45088/0 (socket says 172.21.15.129:45088) 2020-01-26T15:24:13.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f61cc700 1 -- 172.21.15.129:0/496472049 learned_addr learned my addr 172.21.15.129:0/496472049 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899633452 0 0) 0x7f79f007d650 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d0003230 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 796599298 0 0) 0x7f79d0003230 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79f007d650 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f79e40018a0 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 846457909 0 0) 0x7f79f007d650 con 0x7f79f00a38e0 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 msgr2=0x7f79f009e150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:13.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 --2- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 0x7f79f009e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 msgr2=0x7f79f007d100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 --2- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 0x7f79f007d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00a2d90 con 0x7f79f00a38e0 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f00a1530 con 0x7f79f00a38e0 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f013abd0 con 0x7f79f00a38e0 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f79e40047c0 con 0x7f79f00a38e0 2020-01-26T15:24:13.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.034+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f79e4004b30 con 0x7f79f00a38e0 2020-01-26T15:24:13.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.038+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f79e4010570 con 0x7f79f00a38e0 2020-01-26T15:24:13.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.038+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc003360 con 0x7f79f00a38e0 2020-01-26T15:24:13.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.038+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f79e404b8a0 con 0x7f79f00a38e0 2020-01-26T15:24:13.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.042+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f79e4030fc0 con 0x7f79f00a38e0 2020-01-26T15:24:13.169 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.166+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79cc0021f0 con 0x7f79f00a38e0 2020-01-26T15:24:13.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.166+0000 7f79ef7fe700 1 -- 172.21.15.129:0/496472049 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8949 (unknown 3225238715 0 82437876) 0x7f79e404a710 con 0x7f79f00a38e0 2020-01-26T15:24:13.170 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:13.171 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":17,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:08.608996+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":11408}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":11408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":11408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":11408}]},"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":11406}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":11406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":11406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":11406}]},"public_addr":"172.21.15.129:6801/11406","cluster_addr":"172.21.15.129:6802/11406","heartbeat_back_addr":"172.21.15.129:6803/11406","heartbeat_front_addr":"172.21.15.129:6804/11406","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":11410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":11410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":11410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":11410}]},"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":11407}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":11407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":11407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":11407}]},"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:13.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 >> v1:172.21.15.129:6800/16899 conn(0x7f79d003e090 legacy=0x7f79d00405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 >> v1:172.21.15.129:6791/0 conn(0x7f79f00a38e0 legacy=0x7f79f007c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 shutdown_connections 2020-01-26T15:24:13.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 --2- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6790/0 conn(0x7f79f00a2960 0x7f79f007d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 --2- 172.21.15.129:0/496472049 >> v2:172.21.15.129:6791/0 conn(0x7f79f00a24a0 0x7f79f009e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 >> 172.21.15.129:0/496472049 conn(0x7f79f005edd0 msgr2=0x7f79f0072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 shutdown_connections 2020-01-26T15:24:13.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.170+0000 7f79f71ce700 1 -- 172.21.15.129:0/496472049 wait complete. 2020-01-26T15:24:13.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:21:40.257840+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:21:42.851862+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-01-26T15:21:43.236142+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'warn', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'14', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-01-26T15:24:13.184 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-01-26T15:24:13.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 Processor -- start 2020-01-26T15:24:13.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- start start 2020-01-26T15:24:13.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 0x7f8e0c07fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:13.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c066310 con 0x7f8e0c097880 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c025350 con 0x7f8e0c097cb0 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0a7cd0 con 0x7f8e0c0a78a0 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e13776700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f8e0c097cb0 0x7f8e0c14b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47482/0 (socket says 172.21.15.129:47482) 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e11d13700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 0x7f8e0c07fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e11512700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f8e0c097880 0x7f8e0c0a6750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39180/0 (socket says 172.21.15.129:39180) 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e13776700 1 -- 172.21.15.129:0/924259124 learned_addr learned my addr 172.21.15.129:0/924259124 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e11d13700 1 --2- 172.21.15.129:0/924259124 >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 0x7f8e0c07fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252734311 0 0) 0x7f8e0c066310 con 0x7f8e0c097880 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df4003230 con 0x7f8e0c097880 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986660333 0 0) 0x7f8e0c025350 con 0x7f8e0c097cb0 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c066310 con 0x7f8e0c097cb0 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 339925758 0 0) 0x7f8df4003230 con 0x7f8e0c097880 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 msgr2=0x7f8e0c07fd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:13.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 --2- 172.21.15.129:0/924259124 >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 0x7f8e0c07fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 >> v1:172.21.15.129:6790/0 conn(0x7f8e0c097cb0 legacy=0x7f8e0c14b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c14e990 con 0x7f8e0c097880 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8e08001a60 con 0x7f8e0c097880 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8e08001dd0 con 0x7f8e0c097880 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e10d11700 1 -- 172.21.15.129:0/924259124 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8e08004870 con 0x7f8e0c097880 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- 172.21.15.129:0/924259124 >> v1:172.21.15.129:6789/0 conn(0x7f8e0c097880 legacy=0x7f8e0c0a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.298+0000 7f8e12514700 1 -- 172.21.15.129:0/924259124 shutdown_connections 2020-01-26T15:24:13.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 --2- 172.21.15.129:0/924259124 >> v2:172.21.15.129:6790/0 conn(0x7f8e0c0a78a0 0x7f8e0c07fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- 172.21.15.129:0/924259124 >> 172.21.15.129:0/924259124 conn(0x7f8e0c099260 msgr2=0x7f8e0c05f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- 172.21.15.129:0/924259124 shutdown_connections 2020-01-26T15:24:13.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- 172.21.15.129:0/924259124 wait complete. 2020-01-26T15:24:13.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 Processor -- start 2020-01-26T15:24:13.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- start start 2020-01-26T15:24:13.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 0x7f8e0c062430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:13.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c062980 con 0x7f8e0c07ec30 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0a3f40 con 0x7f8e0c0638c0 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c09a160 con 0x7f8e0c062cd0 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e11d13700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 0x7f8e0c062430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e11512700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f8e0c0638c0 0x7f8e0c063cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45102/0 (socket says 172.21.15.129:45102) 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e11512700 1 -- 172.21.15.129:0/1343607397 learned_addr learned my addr 172.21.15.129:0/1343607397 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e11d13700 1 --2- 172.21.15.129:0/1343607397 >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 0x7f8e0c062430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735748330 0 0) 0x7f8e0c0a3f40 con 0x7f8e0c0638c0 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dec003230 con 0x7f8e0c0638c0 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66953119 0 0) 0x7f8e0c062980 con 0x7f8e0c07ec30 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c0a3f40 con 0x7f8e0c07ec30 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1033696574 0 0) 0x7f8dec003230 con 0x7f8e0c0638c0 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e0c062980 con 0x7f8e0c0638c0 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8e080017a0 con 0x7f8e0c0638c0 2020-01-26T15:24:13.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2487729891 0 0) 0x7f8e0c062980 con 0x7f8e0c0638c0 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 msgr2=0x7f8e0c062430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 --2- 172.21.15.129:0/1343607397 >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 0x7f8e0c062430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 >> v1:172.21.15.129:6789/0 conn(0x7f8e0c07ec30 legacy=0x7f8e0c07f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c099d30 con 0x7f8e0c0638c0 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c07f860 con 0x7f8e0c0638c0 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.302+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c1396a0 con 0x7f8e0c0638c0 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.306+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8e08001ab0 con 0x7f8e0c0638c0 2020-01-26T15:24:13.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.306+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c056600 con 0x7f8e0c0638c0 2020-01-26T15:24:13.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.306+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8e08004f70 con 0x7f8e0c0638c0 2020-01-26T15:24:13.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.306+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f8e080109b0 con 0x7f8e0c0638c0 2020-01-26T15:24:13.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.306+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f8e0804bc50 con 0x7f8e0c0638c0 2020-01-26T15:24:13.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.310+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8e080310d0 con 0x7f8e0c0638c0 2020-01-26T15:24:13.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e0c05cc60 con 0x7f8e0c0638c0 2020-01-26T15:24:13.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e027fc700 1 -- 172.21.15.129:0/1343607397 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (unknown 898784134 0 265718887) 0x7f8e08031330 con 0x7f8e0c0638c0 2020-01-26T15:24:13.437 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:24:13.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 >> v1:172.21.15.129:6800/16899 conn(0x7f8dec03e160 legacy=0x7f8dec040670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 >> v1:172.21.15.129:6791/0 conn(0x7f8e0c0638c0 legacy=0x7f8e0c063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 shutdown_connections 2020-01-26T15:24:13.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 --2- 172.21.15.129:0/1343607397 >> v2:172.21.15.129:6791/0 conn(0x7f8e0c062cd0 0x7f8e0c062430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 >> 172.21.15.129:0/1343607397 conn(0x7f8e0c0a4f40 msgr2=0x7f8e0c09ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 shutdown_connections 2020-01-26T15:24:13.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.434+0000 7f8e12514700 1 -- 172.21.15.129:0/1343607397 wait complete. 2020-01-26T15:24:13.454 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-01-26T15:24:13.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.562+0000 7ff4a5385700 1 Processor -- start 2020-01-26T15:24:13.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.562+0000 7ff4a5385700 1 -- start start 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0066310 con 0x7ff4a014a160 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0025350 con 0x7ff4a00a78a0 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a014fdd0 con 0x7ff4a007fd70 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a4b84700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ff4a00a78a0 0x7ff4a0097880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47492/0 (socket says 172.21.15.129:47492) 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a4b84700 1 -- 172.21.15.129:0/1404898631 learned_addr learned my addr 172.21.15.129:0/1404898631 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724821200 0 0) 0x7ff4a014fdd0 con 0x7ff4a007fd70 2020-01-26T15:24:13.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003230 con 0x7ff4a007fd70 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424434362 0 0) 0x7ff4a0025350 con 0x7ff4a00a78a0 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a014fdd0 con 0x7ff4a00a78a0 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641566889 0 0) 0x7ff4a0066310 con 0x7ff4a014a160 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0025350 con 0x7ff4a014a160 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3462478957 0 0) 0x7ff488003230 con 0x7ff4a007fd70 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 >> v1:172.21.15.129:6790/0 conn(0x7ff4a00a78a0 legacy=0x7ff4a0097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 >> v1:172.21.15.129:6789/0 conn(0x7ff4a014a160 legacy=0x7ff4a014c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0151010 con 0x7ff4a007fd70 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff4940016e0 con 0x7ff4a007fd70 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff494001a50 con 0x7ff4a007fd70 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff49f7fe700 1 -- 172.21.15.129:0/1404898631 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff494001e70 con 0x7ff4a007fd70 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- 172.21.15.129:0/1404898631 >> v1:172.21.15.129:6791/0 conn(0x7ff4a007fd70 legacy=0x7ff4a00a6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- 172.21.15.129:0/1404898631 shutdown_connections 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- 172.21.15.129:0/1404898631 >> 172.21.15.129:0/1404898631 conn(0x7ff4a0099260 msgr2=0x7ff4a005f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- 172.21.15.129:0/1404898631 shutdown_connections 2020-01-26T15:24:13.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.566+0000 7ff4a5385700 1 -- 172.21.15.129:0/1404898631 wait complete. 2020-01-26T15:24:13.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a5385700 1 Processor -- start 2020-01-26T15:24:13.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a5385700 1 -- start start 2020-01-26T15:24:13.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a00736f0 con 0x7ff4a0072650 2020-01-26T15:24:13.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0061050 con 0x7ff4a0060c20 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a5385700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a0073e30 con 0x7ff4a0071a20 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a4b84700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ff4a0060c20 0x7ff4a00744c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47500/0 (socket says 172.21.15.129:47500) 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff4a4b84700 1 -- 172.21.15.129:0/331434361 learned_addr learned my addr 172.21.15.129:0/331434361 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783634208 0 0) 0x7ff4a00736f0 con 0x7ff4a0072650 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff480003230 con 0x7ff4a0072650 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767534669 0 0) 0x7ff4a0061050 con 0x7ff4a0060c20 2020-01-26T15:24:13.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00736f0 con 0x7ff4a0060c20 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520500198 0 0) 0x7ff4a0073e30 con 0x7ff4a0071a20 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0061050 con 0x7ff4a0071a20 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 226445879 0 0) 0x7ff480003230 con 0x7ff4a0072650 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4a0073e30 con 0x7ff4a0072650 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3609046626 0 0) 0x7ff4a0061050 con 0x7ff4a0071a20 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff480003230 con 0x7ff4a0071a20 2020-01-26T15:24:13.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff498001ae0 con 0x7ff4a0072650 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff494001b30 con 0x7ff4a0071a20 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1380949310 0 0) 0x7ff4a00736f0 con 0x7ff4a0060c20 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4a0061050 con 0x7ff4a0060c20 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff4900018e0 con 0x7ff4a0060c20 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1696398935 0 0) 0x7ff4a0073e30 con 0x7ff4a0072650 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 >> v1:172.21.15.129:6791/0 conn(0x7ff4a0071a20 legacy=0x7ff4a0071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.570+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 >> v1:172.21.15.129:6790/0 conn(0x7ff4a0060c20 legacy=0x7ff4a00744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0096580 con 0x7ff4a0072650 2020-01-26T15:24:13.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a015b740 con 0x7ff4a0072650 2020-01-26T15:24:13.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a015baf0 con 0x7ff4a0072650 2020-01-26T15:24:13.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7ff498002020 con 0x7ff4a0072650 2020-01-26T15:24:13.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7ff498002490 con 0x7ff4a0072650 2020-01-26T15:24:13.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a0056600 con 0x7ff4a0072650 2020-01-26T15:24:13.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7ff498002690 con 0x7ff4a0072650 2020-01-26T15:24:13.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.574+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7ff498049360 con 0x7ff4a0072650 2020-01-26T15:24:13.582 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.578+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7ff49802ea40 con 0x7ff4a0072650 2020-01-26T15:24:13.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4a00612a0 con 0x7ff4a0072650 2020-01-26T15:24:13.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff49d7fa700 1 -- 172.21.15.129:0/331434361 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+10 (unknown 44878344 0 265718887) 0x7ff4980481f0 con 0x7ff4a0072650 2020-01-26T15:24:13.705 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:24:13.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 >> v1:172.21.15.129:6800/16899 conn(0x7ff48003e8f0 legacy=0x7ff480040e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 >> v1:172.21.15.129:6789/0 conn(0x7ff4a0072650 legacy=0x7ff4a0072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 shutdown_connections 2020-01-26T15:24:13.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 >> 172.21.15.129:0/331434361 conn(0x7ff4a0080010 msgr2=0x7ff4a0150000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 shutdown_connections 2020-01-26T15:24:13.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.702+0000 7ff4a5385700 1 -- 172.21.15.129:0/331434361 wait complete. 2020-01-26T15:24:13.717 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-01-26T15:24:13.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 Processor -- start 2020-01-26T15:24:13.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 -- start start 2020-01-26T15:24:13.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 0x7febd80a6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:13.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 0x7febd814b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd8066310 con 0x7febd80a78a0 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7febd80a7cd0 con 0x7febd807fd70 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdd6f5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7febd80801a0 con 0x7febd80a6ca0 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdcef4700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7febd80a78a0 0x7febd8097880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39206/0 (socket says 172.21.15.129:39206) 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febdcef4700 1 -- 172.21.15.129:0/4201738664 learned_addr learned my addr 172.21.15.129:0/4201738664 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd7fff700 -1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 0x7febd80a6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:13.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febde957700 -1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 0x7febd814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd7fff700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 0x7febd80a6750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febde957700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 0x7febd814b160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936426796 0 0) 0x7febd8066310 con 0x7febd80a78a0 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003230 con 0x7febd80a78a0 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1887247979 0 0) 0x7febc4003230 con 0x7febd80a78a0 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 msgr2=0x7febd814b160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:13.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 0x7febd814b160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 msgr2=0x7febd80a6750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 0x7febd80a6750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8025350 con 0x7febd80a78a0 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.818+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7febc80016e0 con 0x7febd80a78a0 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7febc8001b10 con 0x7febd80a78a0 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febd77fe700 1 -- 172.21.15.129:0/4201738664 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7febc8004730 con 0x7febd80a78a0 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- 172.21.15.129:0/4201738664 >> v1:172.21.15.129:6789/0 conn(0x7febd80a78a0 legacy=0x7febd8097880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- 172.21.15.129:0/4201738664 shutdown_connections 2020-01-26T15:24:13.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6791/0 conn(0x7febd80a6ca0 0x7febd814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 --2- 172.21.15.129:0/4201738664 >> v2:172.21.15.129:6790/0 conn(0x7febd807fd70 0x7febd80a6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:13.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- 172.21.15.129:0/4201738664 >> 172.21.15.129:0/4201738664 conn(0x7febd8099260 msgr2=0x7febd805f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- 172.21.15.129:0/4201738664 shutdown_connections 2020-01-26T15:24:13.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- 172.21.15.129:0/4201738664 wait complete. 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 Processor -- start 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- start start 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 0x7febd807f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd807f750 con 0x7febd809bc20 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80630f0 con 0x7febd809cee0 2020-01-26T15:24:13.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdd6f5700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7febd8062d30 con 0x7febd8062900 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdcef4700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7febd809bc20 0x7febd809c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39212/0 (socket says 172.21.15.129:39212) 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febdcef4700 1 -- 172.21.15.129:0/2611575845 learned_addr learned my addr 172.21.15.129:0/2611575845 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febde957700 -1 --2- 172.21.15.129:0/2611575845 >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 0x7febd807f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.822+0000 7febde957700 1 --2- 172.21.15.129:0/2611575845 >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 0x7febd807f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827238209 0 0) 0x7febd80630f0 con 0x7febd809cee0 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febbc003230 con 0x7febd809cee0 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400089280 0 0) 0x7febd807f750 con 0x7febd809bc20 2020-01-26T15:24:13.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd80630f0 con 0x7febd809bc20 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1856634472 0 0) 0x7febd80630f0 con 0x7febd809bc20 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febd807f750 con 0x7febd809bc20 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7febc8001420 con 0x7febd809bc20 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2708165638 0 0) 0x7febbc003230 con 0x7febd809cee0 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febd80630f0 con 0x7febd809cee0 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7febc00026c0 con 0x7febd809cee0 2020-01-26T15:24:13.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1321605870 0 0) 0x7febd807f750 con 0x7febd809bc20 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 msgr2=0x7febd807f200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 --2- 172.21.15.129:0/2611575845 >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 0x7febd807f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 >> v1:172.21.15.129:6790/0 conn(0x7febd809cee0 legacy=0x7febd807ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8122e70 con 0x7febd809bc20 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd8139540 con 0x7febd809bc20 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7febd8139ac0 con 0x7febd809bc20 2020-01-26T15:24:13.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7febc8004980 con 0x7febd809bc20 2020-01-26T15:24:13.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7febc8004d70 con 0x7febd809bc20 2020-01-26T15:24:13.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7febc80107b0 con 0x7febd809bc20 2020-01-26T15:24:13.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd8062ef0 con 0x7febd809bc20 2020-01-26T15:24:13.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.826+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7febc804b830 con 0x7febd809bc20 2020-01-26T15:24:13.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.834+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7febc8030d70 con 0x7febd809bc20 2020-01-26T15:24:13.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.954+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febd8056600 con 0x7febd809bc20 2020-01-26T15:24:13.958 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.954+0000 7febd57fa700 1 -- 172.21.15.129:0/2611575845 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+10 (unknown 1689594445 0 265718887) 0x7febc8030fd0 con 0x7febd809bc20 2020-01-26T15:24:13.958 INFO:teuthology.orchestra.run.smithi129.stdout:pg_num: 8 2020-01-26T15:24:13.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 >> v1:172.21.15.129:6800/16899 conn(0x7febbc03e410 legacy=0x7febbc040920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 >> v1:172.21.15.129:6789/0 conn(0x7febd809bc20 legacy=0x7febd809c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:13.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 shutdown_connections 2020-01-26T15:24:13.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 --2- 172.21.15.129:0/2611575845 >> v2:172.21.15.129:6790/0 conn(0x7febd8062900 0x7febd807f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:13.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 >> 172.21.15.129:0/2611575845 conn(0x7febd8097db0 msgr2=0x7febd809de90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:13.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 shutdown_connections 2020-01-26T15:24:13.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:13.958+0000 7febdd6f5700 1 -- 172.21.15.129:0/2611575845 wait complete. 2020-01-26T15:24:13.971 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 Processor -- start 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 -- start start 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 0x7fc29414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29405ea20 con 0x7fc29405edd0 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc294098000 con 0x7fc29405e5f0 2020-01-26T15:24:14.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29aad8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc29405e050 con 0x7fc2940a6870 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29a2d7700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc29405edd0 0x7fc29407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39220/0 (socket says 172.21.15.129:39220) 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29a2d7700 1 -- 172.21.15.129:0/1345983935 learned_addr learned my addr 172.21.15.129:0/1345983935 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29bd3a700 -1 --2- 172.21.15.129:0/1345983935 >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 0x7fc29414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc29bd3a700 1 --2- 172.21.15.129:0/1345983935 >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 0x7fc29414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976233315 0 0) 0x7fc29405ea20 con 0x7fc29405edd0 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc280003230 con 0x7fc29405edd0 2020-01-26T15:24:14.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570036137 0 0) 0x7fc294098000 con 0x7fc29405e5f0 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.082+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29405ea20 con 0x7fc29405e5f0 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3083753077 0 0) 0x7fc280003230 con 0x7fc29405edd0 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 msgr2=0x7fc29414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 --2- 172.21.15.129:0/1345983935 >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 0x7fc29414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 >> v1:172.21.15.129:6791/0 conn(0x7fc29405e5f0 legacy=0x7fc294149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2940a6ca0 con 0x7fc29405edd0 2020-01-26T15:24:14.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc2900016e0 con 0x7fc29405edd0 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc290001a50 con 0x7fc29405edd0 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc2992d5700 1 -- 172.21.15.129:0/1345983935 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc2900045b0 con 0x7fc29405edd0 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- 172.21.15.129:0/1345983935 >> v1:172.21.15.129:6789/0 conn(0x7fc29405edd0 legacy=0x7fc29407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- 172.21.15.129:0/1345983935 shutdown_connections 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 --2- 172.21.15.129:0/1345983935 >> v2:172.21.15.129:6790/0 conn(0x7fc2940a6870 0x7fc29414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- 172.21.15.129:0/1345983935 >> 172.21.15.129:0/1345983935 conn(0x7fc294098e70 msgr2=0x7fc2940a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- 172.21.15.129:0/1345983935 shutdown_connections 2020-01-26T15:24:14.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- 172.21.15.129:0/1345983935 wait complete. 2020-01-26T15:24:14.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 Processor -- start 2020-01-26T15:24:14.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- start start 2020-01-26T15:24:14.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 0x7fc294078dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:14.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc294079750 con 0x7fc294079320 2020-01-26T15:24:14.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29407a3c0 con 0x7fc294122600 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29aad8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc2940a5730 con 0x7fc2940789a0 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29a2d7700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fc294122600 0x7fc294079bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45142/0 (socket says 172.21.15.129:45142) 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc29a2d7700 1 -- 172.21.15.129:0/2784296626 learned_addr learned my addr 172.21.15.129:0/2784296626 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc299ad6700 -1 --2- 172.21.15.129:0/2784296626 >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 0x7fc294078dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc299ad6700 1 --2- 172.21.15.129:0/2784296626 >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 0x7fc294078dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009185959 0 0) 0x7fc29407a3c0 con 0x7fc294122600 2020-01-26T15:24:14.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc27c003230 con 0x7fc294122600 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479477692 0 0) 0x7fc294079750 con 0x7fc294079320 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29407a3c0 con 0x7fc294079320 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 254612450 0 0) 0x7fc27c003230 con 0x7fc294122600 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc294079750 con 0x7fc294122600 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc290001420 con 0x7fc294122600 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 586557610 0 0) 0x7fc29407a3c0 con 0x7fc294079320 2020-01-26T15:24:14.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc27c003230 con 0x7fc294079320 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.086+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc28c0029c0 con 0x7fc294079320 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2210593683 0 0) 0x7fc294079750 con 0x7fc294122600 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 msgr2=0x7fc294078dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 --2- 172.21.15.129:0/2784296626 >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 0x7fc294078dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 >> v1:172.21.15.129:6789/0 conn(0x7fc294079320 legacy=0x7fc294138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29411fbf0 con 0x7fc294122600 2020-01-26T15:24:14.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc294124050 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29413a410 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fc290001230 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fc290004a80 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fc290010540 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc270003360 con 0x7fc294122600 2020-01-26T15:24:14.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.090+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7fc29004b800 con 0x7fc294122600 2020-01-26T15:24:14.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.098+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fc290030e50 con 0x7fc294122600 2020-01-26T15:24:14.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.246+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2700037d0 con 0x7fc294122600 2020-01-26T15:24:14.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc28affd700 1 -- 172.21.15.129:0/2784296626 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1709 (unknown 4058427516 0 1458168140) 0x7fc2900310b0 con 0x7fc294122600 2020-01-26T15:24:14.252 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:14.252 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-01-26T15:21:44.187366+0000","modified":"2020-01-26T15:22:01.117365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4209},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4209":{"gid":4209,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.129:6819/2338999715","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6819","nonce":2338999715}]},"export_targets":[],"features":4611087854031667195,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-01-26T15:24:14.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 >> v1:172.21.15.129:6800/16899 conn(0x7fc27c03e3d0 legacy=0x7fc27c0408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 >> v1:172.21.15.129:6791/0 conn(0x7fc294122600 legacy=0x7fc294079bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 shutdown_connections 2020-01-26T15:24:14.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 --2- 172.21.15.129:0/2784296626 >> v2:172.21.15.129:6790/0 conn(0x7fc2940789a0 0x7fc294078dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:14.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 >> 172.21.15.129:0/2784296626 conn(0x7fc2940a4ef0 msgr2=0x7fc29407f220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:14.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 shutdown_connections 2020-01-26T15:24:14.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.250+0000 7fc29aad8700 1 -- 172.21.15.129:0/2784296626 wait complete. 2020-01-26T15:24:14.255 INFO:teuthology.orchestra.run.smithi129.stderr:dumped fsmap epoch 7 2020-01-26T15:24:14.373 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4209}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4209': {u'export_targets': [], u'name': u'c', u'incarnation': 4, u'state_seq': 2, u'state': u'up:active', u'gid': 4209, u'features': 4611087854031667195, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2338999715, u'type': u'v1', u'addr': u'172.21.15.129:6819'}]}, u'addr': u'172.21.15.129:6819/2338999715'}}, u'fs_name': u'cephfs', u'created': u'2020-01-26T15:21:44.187366+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-01-26T15:22:01.117365+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-01-26T15:24:14.373 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-01-26T15:24:14.373 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok status 2020-01-26T15:24:14.485 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:24:14.485 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:24:14.485 INFO:teuthology.orchestra.run.smithi129.stdout: "whoami": 0, 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4209, 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "want_state": "up:active", 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "state": "up:active", 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "rank_uptime": 148.678161, 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 6, 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch": 17, 2020-01-26T15:24:14.486 INFO:teuthology.orchestra.run.smithi129.stdout: "osdmap_epoch_barrier": 16, 2020-01-26T15:24:14.487 INFO:teuthology.orchestra.run.smithi129.stdout: "uptime": 148.719577 2020-01-26T15:24:14.487 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:24:14.494 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", "whoami": 0, "id": 4209, "want_state": "up:active", "state": "up:active", "rank_uptime": 148.678161, "mdsmap_epoch": 6, "osdmap_epoch": 17, "osdmap_epoch_barrier": 16, "uptime": 148.719577 } 2020-01-26T15:24:14.495 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:24:14.508 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-01-26T15:24:14.508 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:14.581 INFO:tasks.ceph.osd.1:Stopped 2020-01-26T15:24:14.581 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2020-01-26T15:24:14.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 Processor -- start 2020-01-26T15:24:14.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- start start 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 0x7f65900a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900a6dc0 con 0x7f6590149040 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659005ea20 con 0x7f659005edd0 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6590098000 con 0x7f659005e5f0 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658f7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f659005edd0 0x7f659007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47548/0 (socket says 172.21.15.129:47548) 2020-01-26T15:24:14.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658f7fe700 1 -- 172.21.15.129:0/3440871767 learned_addr learned my addr 172.21.15.129:0/3440871767 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f6595499700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f6590149040 0x7f659014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39252/0 (socket says 172.21.15.129:39252) 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f6586ffd700 -1 --2- 172.21.15.129:0/3440871767 >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 0x7f65900a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f6586ffd700 1 --2- 172.21.15.129:0/3440871767 >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 0x7f65900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318335264 0 0) 0x7f65900a6dc0 con 0x7f6590149040 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003230 con 0x7f6590149040 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465886863 0 0) 0x7f659005ea20 con 0x7f659005edd0 2020-01-26T15:24:14.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65900a6dc0 con 0x7f659005edd0 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3243186004 0 0) 0x7f657c003230 con 0x7f6590149040 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 msgr2=0x7f65900a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 --2- 172.21.15.129:0/3440871767 >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 0x7f65900a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 >> v1:172.21.15.129:6790/0 conn(0x7f659005edd0 legacy=0x7f659007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659005e050 con 0x7f6590149040 2020-01-26T15:24:14.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6588001a60 con 0x7f6590149040 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f6588001d50 con 0x7f6590149040 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658effd700 1 -- 172.21.15.129:0/3440871767 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6588004870 con 0x7f6590149040 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- 172.21.15.129:0/3440871767 >> v1:172.21.15.129:6789/0 conn(0x7f6590149040 legacy=0x7f659014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- 172.21.15.129:0/3440871767 shutdown_connections 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 --2- 172.21.15.129:0/3440871767 >> v2:172.21.15.129:6790/0 conn(0x7f659005e5f0 0x7f65900a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- 172.21.15.129:0/3440871767 >> 172.21.15.129:0/3440871767 conn(0x7f6590098e70 msgr2=0x7f65900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:14.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- 172.21.15.129:0/3440871767 shutdown_connections 2020-01-26T15:24:14.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.698+0000 7f658ffff700 1 -- 172.21.15.129:0/3440871767 wait complete. 2020-01-26T15:24:14.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 Processor -- start 2020-01-26T15:24:14.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 -- start start 2020-01-26T15:24:14.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 0x7f659007c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:14.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65901218d0 con 0x7f6590120590 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6590120210 con 0x7f65901383d0 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658ffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f659009de10 con 0x7f659007c030 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658f7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f6590120590 0x7f659009edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47554/0 (socket says 172.21.15.129:47554) 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f658f7fe700 1 -- 172.21.15.129:0/1721741726 learned_addr learned my addr 172.21.15.129:0/1721741726 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f6586ffd700 -1 --2- 172.21.15.129:0/1721741726 >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 0x7f659007c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.702+0000 7f6586ffd700 1 --2- 172.21.15.129:0/1721741726 >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 0x7f659007c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:14.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216050480 0 0) 0x7f65901218d0 con 0x7f6590120590 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6574003230 con 0x7f6590120590 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809611606 0 0) 0x7f6590120210 con 0x7f65901383d0 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65901218d0 con 0x7f65901383d0 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 359895917 0 0) 0x7f6574003230 con 0x7f6590120590 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6590120210 con 0x7f6590120590 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2582732976 0 0) 0x7f65901218d0 con 0x7f65901383d0 2020-01-26T15:24:14.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6574003230 con 0x7f65901383d0 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f65800018e0 con 0x7f6590120590 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6588001cb0 con 0x7f65901383d0 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1623148782 0 0) 0x7f6590120210 con 0x7f6590120590 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 msgr2=0x7f659007c460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 --2- 172.21.15.129:0/1721741726 >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 0x7f659007c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 >> v1:172.21.15.129:6791/0 conn(0x7f65901383d0 legacy=0x7f659013a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:14.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590121010 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65900a3740 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f659013c020 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f65800047a0 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f6580004b10 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f6580010550 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(17..17 src has 1..17) v4 ==== 2854+0+0 (unknown 1405012946 0 0) 0x7f658004b830 con 0x7f6590120590 2020-01-26T15:24:14.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.706+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659009e2f0 con 0x7f6590120590 2020-01-26T15:24:14.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.714+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f6580031020 con 0x7f6590120590 2020-01-26T15:24:14.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:14.846+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f6590056600 con 0x7f6590120590 2020-01-26T15:24:14.849 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26T15:24:14.846+0000 7fa2e728e700 -1 mon.a@0(leader).osd e17 definitely_dead 0 2020-01-26T15:24:15.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.414+0000 7f658cff9700 1 -- 172.21.15.129:0/1721741726 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v18) v1 ==== 89+0+0 (unknown 2325400668 0 0) 0x7f658004a710 con 0x7f6590120590 2020-01-26T15:24:15.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 >> v1:172.21.15.129:6800/16899 conn(0x7f657403e410 legacy=0x7f6574040920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:15.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 >> v1:172.21.15.129:6790/0 conn(0x7f6590120590 legacy=0x7f659009edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:15.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 shutdown_connections 2020-01-26T15:24:15.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 --2- 172.21.15.129:0/1721741726 >> v2:172.21.15.129:6790/0 conn(0x7f659007c030 0x7f659007c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:15.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 >> 172.21.15.129:0/1721741726 conn(0x7f6590122dd0 msgr2=0x7f659007df80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:15.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 shutdown_connections 2020-01-26T15:24:15.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.418+0000 7f658ffff700 1 -- 172.21.15.129:0/1721741726 wait complete. 2020-01-26T15:24:15.422 INFO:teuthology.orchestra.run.smithi129.stderr:marked down osd.1. 2020-01-26T15:24:15.433 INFO:tasks.ceph.osd.1:Restarting daemon 2020-01-26T15:24:15.433 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-01-26T15:24:15.435 INFO:tasks.ceph.osd.1:Started 2020-01-26T15:24:15.436 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-01-26T15:24:15.436 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:15.492 INFO:tasks.ceph.osd.0:Stopped 2020-01-26T15:24:15.492 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2020-01-26T15:24:15.502 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:15.498+0000 7fd3252d8700 -1 --2- 172.21.15.129:0/3789895365 >> v2:172.21.15.129:6791/0 conn(0x5651c17b8400 0x5651c242c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.594+0000 7fb8b9787700 1 Processor -- start 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.594+0000 7fb8b9787700 1 -- start start 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 0x7fb8b40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 0x7fb8b414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40a6dc0 con 0x7fb8b405edd0 2020-01-26T15:24:15.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b405ea20 con 0x7fb8b4149040 2020-01-26T15:24:15.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b4098000 con 0x7fb8b405e5f0 2020-01-26T15:24:15.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b3fff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 0x7fb8b40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:15.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8ba9e9700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 0x7fb8b414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:15.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b8f86700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb8b405edd0 0x7fb8b407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47612/0 (socket says 172.21.15.129:47612) 2020-01-26T15:24:15.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b3fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 0x7fb8b40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b8f86700 1 -- 172.21.15.129:0/3740461456 learned_addr learned my addr 172.21.15.129:0/3740461456 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8ba9e9700 1 --2- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 0x7fb8b414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912030978 0 0) 0x7fb8b40a6dc0 con 0x7fb8b405edd0 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a0003230 con 0x7fb8b405edd0 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2767693289 0 0) 0x7fb8a0003230 con 0x7fb8b405edd0 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 msgr2=0x7fb8b40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:15.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 --2- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 0x7fb8b40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 msgr2=0x7fb8b414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 --2- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 0x7fb8b414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b405e050 con 0x7fb8b405edd0 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb8a4001a60 con 0x7fb8b405edd0 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb8a4001d00 con 0x7fb8b405edd0 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b37fe700 1 -- 172.21.15.129:0/3740461456 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb8a4004930 con 0x7fb8b405edd0 2020-01-26T15:24:15.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- 172.21.15.129:0/3740461456 >> v1:172.21.15.129:6790/0 conn(0x7fb8b405edd0 legacy=0x7fb8b407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- 172.21.15.129:0/3740461456 shutdown_connections 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 --2- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6790/0 conn(0x7fb8b4149040 0x7fb8b414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 --2- 172.21.15.129:0/3740461456 >> v2:172.21.15.129:6791/0 conn(0x7fb8b405e5f0 0x7fb8b40a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- 172.21.15.129:0/3740461456 >> 172.21.15.129:0/3740461456 conn(0x7fb8b4098e70 msgr2=0x7fb8b40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- 172.21.15.129:0/3740461456 shutdown_connections 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.598+0000 7fb8b9787700 1 -- 172.21.15.129:0/3740461456 wait complete. 2020-01-26T15:24:15.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 Processor -- start 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- start start 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4120d90 con 0x7fb8b409f0e0 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b409f5c0 con 0x7fb8b40794f0 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4123c90 con 0x7fb8b409ecb0 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b8f86700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fb8b409ecb0 0x7fb8b4131010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45234/0 (socket says 172.21.15.129:45234) 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b8f86700 1 -- 172.21.15.129:0/2759308759 learned_addr learned my addr 172.21.15.129:0/2759308759 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:15.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8ba9e9700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb8b40794f0 0x7fb8b41396a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47618/0 (socket says 172.21.15.129:47618) 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775690654 0 0) 0x7fb8b4123c90 con 0x7fb8b409ecb0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898003230 con 0x7fb8b409ecb0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058369963 0 0) 0x7fb8b409f5c0 con 0x7fb8b40794f0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b4123c90 con 0x7fb8b40794f0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362337786 0 0) 0x7fb8b4120d90 con 0x7fb8b409f0e0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b409f5c0 con 0x7fb8b409f0e0 2020-01-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 775405699 0 0) 0x7fb898003230 con 0x7fb8b409ecb0 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8b4120d90 con 0x7fb8b409ecb0 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb8a4001bb0 con 0x7fb8b409ecb0 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2052292216 0 0) 0x7fb8b4120d90 con 0x7fb8b409ecb0 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 >> v1:172.21.15.129:6790/0 conn(0x7fb8b40794f0 legacy=0x7fb8b41396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 >> v1:172.21.15.129:6789/0 conn(0x7fb8b409f0e0 legacy=0x7fb8b4078cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4079920 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b413aeb0 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b413b380 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fb8a4001550 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fb8a4004d00 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fb8a40107c0 con 0x7fb8b409ecb0 2020-01-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.602+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(18..18 src has 1..18) v4 ==== 2854+0+0 (unknown 3999831021 0 0) 0x7fb8a404bb50 con 0x7fb8b409ecb0 2020-01-26T15:24:15.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.606+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c003360 con 0x7fb8b409ecb0 2020-01-26T15:24:15.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.606+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fb8a40312f0 con 0x7fb8b409ecb0 2020-01-26T15:24:15.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:15.738+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fb88c0037d0 con 0x7fb8b409ecb0 2020-01-26T15:24:15.743 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26T15:24:15.742+0000 7fa2e728e700 -1 mon.a@0(leader).osd e18 definitely_dead 0 2020-01-26T15:24:16.037 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.034+0000 7fd329e05d80 -1 Falling back to public interface 2020-01-26T15:24:16.342 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.338+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:16.342 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.338+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.346 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.347 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:16.342+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:16.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.418+0000 7fb8b17fa700 1 -- 172.21.15.129:0/2759308759 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v19) v1 ==== 89+0+0 (unknown 1520786769 0 0) 0x7fb8a404a9e0 con 0x7fb8b409ecb0 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 >> v1:172.21.15.129:6800/16899 conn(0x7fb89803e450 legacy=0x7fb898040960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 >> v1:172.21.15.129:6791/0 conn(0x7fb8b409ecb0 legacy=0x7fb8b4131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 shutdown_connections 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 >> 172.21.15.129:0/2759308759 conn(0x7fb8b40a67d0 msgr2=0x7fb8b40a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 shutdown_connections 2020-01-26T15:24:16.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.422+0000 7fb8b9787700 1 -- 172.21.15.129:0/2759308759 wait complete. 2020-01-26T15:24:16.426 INFO:teuthology.orchestra.run.smithi129.stderr:marked down osd.0. 2020-01-26T15:24:16.437 INFO:tasks.ceph.osd.0:Restarting daemon 2020-01-26T15:24:16.437 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-01-26T15:24:16.481 INFO:tasks.ceph.osd.0:Started 2020-01-26T15:24:16.481 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-01-26T15:24:16.481 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:16.547 INFO:tasks.ceph.osd.3:Stopped 2020-01-26T15:24:16.547 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2020-01-26T15:24:16.559 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:16.558+0000 7fccac9fa700 -1 --2- 172.21.15.129:0/2743197804 >> v2:172.21.15.129:6790/0 conn(0x55ce164aa400 0x55ce1711e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:16.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 Processor -- start 2020-01-26T15:24:16.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 -- start start 2020-01-26T15:24:16.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 0x7f24500a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:16.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500a5b80 con 0x7f24500a4b50 2020-01-26T15:24:16.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2450080440 con 0x7f245005f250 2020-01-26T15:24:16.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2456eb0700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f24500a43f0 con 0x7f24500a5750 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2454c4c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f24500a4b50 0x7f245005ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39362/0 (socket says 172.21.15.129:39362) 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2454c4c700 1 -- 172.21.15.129:0/3399760722 learned_addr learned my addr 172.21.15.129:0/3399760722 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f245544d700 -1 --2- 172.21.15.129:0/3399760722 >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 0x7f24500a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f2455c4e700 1 --1- 172.21.15.129:0/3399760722 >> v1:172.21.15.129:6790/0 conn(0x7f245005f250 0x7f245014bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47664/0 (socket says 172.21.15.129:47664) 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.662+0000 7f245544d700 1 --2- 172.21.15.129:0/3399760722 >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 0x7f24500a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.666+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694694448 0 0) 0x7f24500a5b80 con 0x7f24500a4b50 2020-01-26T15:24:16.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.666+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2438003230 con 0x7f24500a4b50 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.666+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217036523 0 0) 0x7f2450080440 con 0x7f245005f250 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.666+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24500a5b80 con 0x7f245005f250 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 888485479 0 0) 0x7f24500a5b80 con 0x7f245005f250 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 msgr2=0x7f24500a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 --2- 172.21.15.129:0/3399760722 >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 0x7f24500a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 >> v1:172.21.15.129:6789/0 conn(0x7f24500a4b50 legacy=0x7f245005ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:16.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500a3210 con 0x7f245005f250 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f2440001970 con 0x7f245005f250 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f2440001ce0 con 0x7f245005f250 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f244ffff700 1 -- 172.21.15.129:0/3399760722 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f2440004870 con 0x7f245005f250 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- 172.21.15.129:0/3399760722 >> v1:172.21.15.129:6790/0 conn(0x7f245005f250 legacy=0x7f245014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- 172.21.15.129:0/3399760722 shutdown_connections 2020-01-26T15:24:16.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 --2- 172.21.15.129:0/3399760722 >> v2:172.21.15.129:6790/0 conn(0x7f24500a5750 0x7f24500a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:16.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- 172.21.15.129:0/3399760722 >> 172.21.15.129:0/3399760722 conn(0x7f245005e050 msgr2=0x7f2450098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:16.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- 172.21.15.129:0/3399760722 shutdown_connections 2020-01-26T15:24:16.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- 172.21.15.129:0/3399760722 wait complete. 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 Processor -- start 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 -- start start 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.670+0000 7f2456eb0700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 0x7f2450121660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 0x7f245007a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245007bbe0 con 0x7f245007af10 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2450060f10 con 0x7f2450120680 2020-01-26T15:24:16.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f245011e6e0 con 0x7f2450060ae0 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2455c4e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f245007af10 0x7f2450130e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47670/0 (socket says 172.21.15.129:47670) 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2454c4c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 0x7f245007a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2455c4e700 1 -- 172.21.15.129:0/952605578 learned_addr learned my addr 172.21.15.129:0/952605578 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f245544d700 -1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 0x7f2450121660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f245544d700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 0x7f2450121660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2454c4c700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 0x7f245007a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:16.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910615790 0 0) 0x7f245007bbe0 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2430003230 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2938541199 0 0) 0x7f2430003230 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f245007bbe0 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f2440001c40 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3104085763 0 0) 0x7f245007bbe0 con 0x7f245007af10 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 msgr2=0x7f2450121660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:16.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 0x7f2450121660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 msgr2=0x7f245007a9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 0x7f245007a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450120280 con 0x7f245007af10 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2450120ab0 con 0x7f245007af10 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f245007b340 con 0x7f245007af10 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f2440001fd0 con 0x7f245007af10 2020-01-26T15:24:16.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f2440004fb0 con 0x7f245007af10 2020-01-26T15:24:16.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f24400109f0 con 0x7f245007af10 2020-01-26T15:24:16.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2428003360 con 0x7f245007af10 2020-01-26T15:24:16.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.674+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 2854+0+0 (unknown 2038527575 0 0) 0x7f244004bb50 con 0x7f245007af10 2020-01-26T15:24:16.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.678+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2440031350 con 0x7f245007af10 2020-01-26T15:24:16.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:16.810+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f24280037d0 con 0x7f245007af10 2020-01-26T15:24:16.973 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26T15:24:16.814+0000 7fa2e728e700 -1 mon.a@0(leader).osd e19 definitely_dead 0 2020-01-26T15:24:17.093 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.090+0000 7fccb1527d80 -1 Falling back to public interface 2020-01-26T15:24:17.410 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.406+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:17.410 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.406+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:17.416 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.416 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.416 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.416 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.416 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.417 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.417 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.417 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:17.410+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.414+0000 7f244dffb700 1 -- 172.21.15.129:0/952605578 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v20) v1 ==== 89+0+0 (unknown 590159330 0 0) 0x7f2440031f00 con 0x7f245007af10 2020-01-26T15:24:17.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 >> v1:172.21.15.129:6800/16899 conn(0x7f243003e030 legacy=0x7f2430040540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:17.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 >> v1:172.21.15.129:6790/0 conn(0x7f245007af10 legacy=0x7f2450130e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:17.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 shutdown_connections 2020-01-26T15:24:17.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6791/0 conn(0x7f2450060ae0 0x7f2450121660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:17.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 --2- 172.21.15.129:0/952605578 >> v2:172.21.15.129:6790/0 conn(0x7f2450120680 0x7f245007a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:17.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 >> 172.21.15.129:0/952605578 conn(0x7f2450095540 msgr2=0x7f245005f240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:17.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 shutdown_connections 2020-01-26T15:24:17.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.418+0000 7f2456eb0700 1 -- 172.21.15.129:0/952605578 wait complete. 2020-01-26T15:24:17.424 INFO:teuthology.orchestra.run.smithi129.stderr:marked down osd.3. 2020-01-26T15:24:17.438 INFO:tasks.ceph.osd.3:Restarting daemon 2020-01-26T15:24:17.439 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-01-26T15:24:17.480 INFO:tasks.ceph.osd.3:Started 2020-01-26T15:24:17.481 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-01-26T15:24:17.481 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:17.481 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.478+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:17.482 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.478+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:17.483 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.484 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.485 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.485 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.486 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.486 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.486 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.487 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd31905d700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:17.487 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: legacy statfs record found, removing 2020-01-26T15:24:17.487 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:24:17.488 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:17.482+0000 7fd329e05d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:24:17.536 INFO:tasks.ceph.osd.2:Stopped 2020-01-26T15:24:17.537 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2020-01-26T15:24:17.545 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:17.542+0000 7f387c6bc700 -1 --2- 172.21.15.129:0/1335381938 >> v2:172.21.15.129:6791/0 conn(0x56159de82400 0x56159eaf6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:17.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 Processor -- start 2020-01-26T15:24:17.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- start start 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 0x7f532014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532005ea20 con 0x7f532005edd0 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5320098000 con 0x7f532005e5f0 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f532005e050 con 0x7f53200a6870 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5324af5700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f532005e5f0 0x7f5320149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45312/0 (socket says 172.21.15.129:45312) 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f53252f6700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f532005edd0 0x7f532007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39394/0 (socket says 172.21.15.129:39394) 2020-01-26T15:24:17.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5324af5700 1 -- 172.21.15.129:0/31240505 learned_addr learned my addr 172.21.15.129:0/31240505 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5326d59700 -1 --2- 172.21.15.129:0/31240505 >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 0x7f532014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5326d59700 1 --2- 172.21.15.129:0/31240505 >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 0x7f532014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469207702 0 0) 0x7f532005ea20 con 0x7f532005edd0 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c003230 con 0x7f532005edd0 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426791874 0 0) 0x7f5320098000 con 0x7f532005e5f0 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f532005ea20 con 0x7f532005e5f0 2020-01-26T15:24:17.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1088824790 0 0) 0x7f530c003230 con 0x7f532005edd0 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 msgr2=0x7f532014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 --2- 172.21.15.129:0/31240505 >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 0x7f532014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 >> v1:172.21.15.129:6791/0 conn(0x7f532005e5f0 legacy=0x7f5320149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200a6ca0 con 0x7f532005edd0 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f531c0016e0 con 0x7f532005edd0 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f531c001a50 con 0x7f532005edd0 2020-01-26T15:24:17.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5317fff700 1 -- 172.21.15.129:0/31240505 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f531c0044f0 con 0x7f532005edd0 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- 172.21.15.129:0/31240505 >> v1:172.21.15.129:6789/0 conn(0x7f532005edd0 legacy=0x7f532007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- 172.21.15.129:0/31240505 shutdown_connections 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 --2- 172.21.15.129:0/31240505 >> v2:172.21.15.129:6791/0 conn(0x7f53200a6870 0x7f532014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- 172.21.15.129:0/31240505 >> 172.21.15.129:0/31240505 conn(0x7f5320098e70 msgr2=0x7f53200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- 172.21.15.129:0/31240505 shutdown_connections 2020-01-26T15:24:17.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.638+0000 7f5325af7700 1 -- 172.21.15.129:0/31240505 wait complete. 2020-01-26T15:24:17.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 Processor -- start 2020-01-26T15:24:17.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- start start 2020-01-26T15:24:17.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 0x7f53200a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:17.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 0x7f532009e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:17.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53200a14e0 con 0x7f532007c9e0 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f532011f6c0 con 0x7f53200a05a0 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f53200a1b00 con 0x7f532009e060 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5326d59700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f532007c9e0 0x7f532007ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45318/0 (socket says 172.21.15.129:45318) 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5326d59700 1 -- 172.21.15.129:0/574636645 learned_addr learned my addr 172.21.15.129:0/574636645 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5324af5700 -1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 0x7f532009e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5324af5700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 0x7f532009e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:17.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f53252f6700 -1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 0x7f53200a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f53252f6700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 0x7f53200a0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704004899 0 0) 0x7f53180022d0 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5300003230 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1708321202 0 0) 0x7f5300003230 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f53180022d0 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f5318002c50 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4135886360 0 0) 0x7f53180022d0 con 0x7f532007c9e0 2020-01-26T15:24:17.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 msgr2=0x7f532009e490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 0x7f532009e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 msgr2=0x7f53200a0f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 0x7f53200a0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532009e9e0 con 0x7f532007c9e0 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5320099db0 con 0x7f532007c9e0 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f532007d610 con 0x7f532007c9e0 2020-01-26T15:24:17.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f53180015c0 con 0x7f532007c9e0 2020-01-26T15:24:17.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.642+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f53180019a0 con 0x7f532007c9e0 2020-01-26T15:24:17.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.646+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f5318001ba0 con 0x7f532007c9e0 2020-01-26T15:24:17.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.646+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320056600 con 0x7f532007c9e0 2020-01-26T15:24:17.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.646+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(20..20 src has 1..20) v4 ==== 2854+0+0 (unknown 2418562402 0 0) 0x7f53200a14e0 con 0x7f532007c9e0 2020-01-26T15:24:17.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.646+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f5318031640 con 0x7f532007c9e0 2020-01-26T15:24:17.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:17.778+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f532005cc60 con 0x7f532007c9e0 2020-01-26T15:24:17.781 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26T15:24:17.778+0000 7fa2e728e700 -1 mon.a@0(leader).osd e20 definitely_dead 0 2020-01-26T15:24:18.124 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.122+0000 7f38811e9d80 -1 Falling back to public interface 2020-01-26T15:24:18.316 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:18.314+0000 7fd329e05d80 -1 osd.1 17 log_to_monitors {default=true} 2020-01-26T15:24:18.317 INFO:tasks.ceph.osd.1.smithi129.stderr:2020-01-26T15:24:18.314+0000 7fd324ad7700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.426+0000 7f5315ffb700 1 -- 172.21.15.129:0/574636645 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v21) v1 ==== 89+0+0 (unknown 4078079215 0 0) 0x7f5318001eb0 con 0x7f532007c9e0 2020-01-26T15:24:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 >> v1:172.21.15.129:6800/16899 conn(0x7f530003e020 legacy=0x7f5300040530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 >> v1:172.21.15.129:6791/0 conn(0x7f532007c9e0 legacy=0x7f532007ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 shutdown_connections 2020-01-26T15:24:18.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6790/0 conn(0x7f53200a05a0 0x7f53200a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 --2- 172.21.15.129:0/574636645 >> v2:172.21.15.129:6791/0 conn(0x7f532009e060 0x7f532009e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 >> 172.21.15.129:0/574636645 conn(0x7f53200a7a80 msgr2=0x7f532007de40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:18.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 shutdown_connections 2020-01-26T15:24:18.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.430+0000 7f5325af7700 1 -- 172.21.15.129:0/574636645 wait complete. 2020-01-26T15:24:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:marked down osd.2. 2020-01-26T15:24:18.437 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.434+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:18.437 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.434+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.440 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.441 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.441 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.441 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.441 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:18.438+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.444 INFO:tasks.ceph.osd.2:Restarting daemon 2020-01-26T15:24:18.444 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-01-26T15:24:18.447 INFO:tasks.ceph.osd.2:Started 2020-01-26T15:24:18.447 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:24:18.447 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:18.503 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:18.502+0000 7fbf6a1df700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x562605363b00 0x562605fd4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.542+0000 7f0b4ca1a700 1 Processor -- start 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.542+0000 7f0b4ca1a700 1 -- start start 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 0x7f0b480a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b480a6dc0 con 0x7f0b4805edd0 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4805ea20 con 0x7f0b48149040 2020-01-26T15:24:18.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0b48098000 con 0x7f0b4805e5f0 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4dc7c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f0b48149040 0x7f0b4814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45336/0 (socket says 172.21.15.129:45336) 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4dc7c700 1 -- 172.21.15.129:0/844389470 learned_addr learned my addr 172.21.15.129:0/844389470 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b47fff700 1 --1- 172.21.15.129:0/844389470 >> v1:172.21.15.129:6789/0 conn(0x7f0b4805edd0 0x7f0b4807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39418/0 (socket says 172.21.15.129:39418) 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b477fe700 -1 --2- 172.21.15.129:0/844389470 >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 0x7f0b480a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b477fe700 1 --2- 172.21.15.129:0/844389470 >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 0x7f0b480a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979892133 0 0) 0x7f0b4805ea20 con 0x7f0b48149040 2020-01-26T15:24:18.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b30003230 con 0x7f0b48149040 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866182311 0 0) 0x7f0b480a6dc0 con 0x7f0b4805edd0 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4805ea20 con 0x7f0b4805edd0 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4046920005 0 0) 0x7f0b30003230 con 0x7f0b48149040 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 msgr2=0x7f0b480a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 --2- 172.21.15.129:0/844389470 >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 0x7f0b480a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:18.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 >> v1:172.21.15.129:6789/0 conn(0x7f0b4805edd0 legacy=0x7f0b4807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4805e050 con 0x7f0b48149040 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0b40001a60 con 0x7f0b48149040 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0b40001dd0 con 0x7f0b48149040 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b46ffd700 1 -- 172.21.15.129:0/844389470 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0b40004930 con 0x7f0b48149040 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/844389470 >> v1:172.21.15.129:6791/0 conn(0x7f0b48149040 legacy=0x7f0b4814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/844389470 shutdown_connections 2020-01-26T15:24:18.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 --2- 172.21.15.129:0/844389470 >> v2:172.21.15.129:6790/0 conn(0x7f0b4805e5f0 0x7f0b480a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:18.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/844389470 >> 172.21.15.129:0/844389470 conn(0x7f0b48098e70 msgr2=0x7f0b480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:18.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/844389470 shutdown_connections 2020-01-26T15:24:18.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.546+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/844389470 wait complete. 2020-01-26T15:24:18.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 Processor -- start 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 -- start start 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 0x7f0b48024b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 0x7f0b4807ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4809bb80 con 0x7f0b4809af50 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480a1630 con 0x7f0b4809a330 2020-01-26T15:24:18.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4ca1a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0b48099a90 con 0x7f0b4807c9e0 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b47fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 0x7f0b48024b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4dc7c700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 0x7f0b4807ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b477fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f0b4809af50 0x7f0b4809b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47726/0 (socket says 172.21.15.129:47726) 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b477fe700 1 -- 172.21.15.129:0/3826468027 learned_addr learned my addr 172.21.15.129:0/3826468027 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b47fff700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 0x7f0b48024b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b4dc7c700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 0x7f0b4807ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:18.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527034587 0 0) 0x7f0b4809bb80 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.550+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003230 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1709747811 0 0) 0x7f0b28003230 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b4809bb80 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0b3c002750 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2151123038 0 0) 0x7f0b4809bb80 con 0x7f0b4809af50 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 msgr2=0x7f0b4807ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:18.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 0x7f0b4807ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 msgr2=0x7f0b48024b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:18.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 0x7f0b48024b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480a1200 con 0x7f0b4809af50 2020-01-26T15:24:18.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4807d360 con 0x7f0b4809af50 2020-01-26T15:24:18.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b48138980 con 0x7f0b4809af50 2020-01-26T15:24:18.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f0b3c000f50 con 0x7f0b4809af50 2020-01-26T15:24:18.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f0b3c0012f0 con 0x7f0b4809af50 2020-01-26T15:24:18.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b48056600 con 0x7f0b4809af50 2020-01-26T15:24:18.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f0b3c001570 con 0x7f0b4809af50 2020-01-26T15:24:18.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.554+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(21..21 src has 1..21) v4 ==== 2854+0+0 (unknown 130134232 0 0) 0x7f0b3c04ba70 con 0x7f0b4809af50 2020-01-26T15:24:18.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.562+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f0b3c031210 con 0x7f0b4809af50 2020-01-26T15:24:18.667 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.666+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:18.668 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.666+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:18.670 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.666+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.671 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.666+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.671 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.672 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.672 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.673 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.673 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.673 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.670+0000 7fcca077f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:18.676 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.674+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: legacy statfs record found, removing 2020-01-26T15:24:18.676 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.674+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:24:18.677 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:18.674+0000 7fccb1527d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:24:18.686 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.682+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b48025140 con 0x7f0b4809af50 2020-01-26T15:24:18.687 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.682+0000 7f0b44ff9700 1 -- 172.21.15.129:0/3826468027 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+8963 (unknown 898900276 0 72677865) 0x7f0b3c04a900 con 0x7f0b4809af50 2020-01-26T15:24:18.687 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:18.688 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":21,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:18.422803+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":11408}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":11408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":11408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":11408}]},"public_addr":"172.21.15.129:6809/11408","cluster_addr":"172.21.15.129:6810/11408","heartbeat_back_addr":"172.21.15.129:6811/11408","heartbeat_front_addr":"172.21.15.129:6812/11408","state":["exists"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":13,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":11410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":11410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":11410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":11410}]},"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":11407}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":11407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":11407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":11407}]},"public_addr":"172.21.15.129:6805/11407","cluster_addr":"172.21.15.129:6806/11407","heartbeat_back_addr":"172.21.15.129:6807/11407","heartbeat_front_addr":"172.21.15.129:6808/11407","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 >> v1:172.21.15.129:6800/16899 conn(0x7f0b2803e050 legacy=0x7f0b28040560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 >> v1:172.21.15.129:6790/0 conn(0x7f0b4809af50 legacy=0x7f0b4809b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 shutdown_connections 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6791/0 conn(0x7f0b4807c9e0 0x7f0b4807ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 --2- 172.21.15.129:0/3826468027 >> v2:172.21.15.129:6790/0 conn(0x7f0b4809a330 0x7f0b48024b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 >> 172.21.15.129:0/3826468027 conn(0x7f0b4805e5f0 msgr2=0x7f0b4807e120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:18.689 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 shutdown_connections 2020-01-26T15:24:18.690 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:18.686+0000 7f0b4ca1a700 1 -- 172.21.15.129:0/3826468027 wait complete. 2020-01-26T15:24:19.209 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:19.206+0000 7fbf6f50dd80 -1 Falling back to public interface 2020-01-26T15:24:19.517 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:19.514+0000 7fccb1527d80 -1 osd.0 17 log_to_monitors {default=true} 2020-01-26T15:24:19.518 INFO:tasks.ceph.osd.0.smithi129.stderr:2020-01-26T15:24:19.514+0000 7fccab9f8700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:19.571 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:19.570+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:19.571 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:19.570+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:19.574 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:19.570+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.574 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:19.570+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.641 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.638+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:19.641 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.638+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:19.644 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.644 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.644 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.645 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.645 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.645 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.646 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.646 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.646 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.646 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f386fc40700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:19.647 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: legacy statfs record found, removing 2020-01-26T15:24:19.647 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:24:19.647 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:19.642+0000 7f38811e9d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:24:20.478 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:20.474+0000 7f38811e9d80 -1 osd.3 19 log_to_monitors {default=true} 2020-01-26T15:24:20.479 INFO:tasks.ceph.osd.3.smithi129.stderr:2020-01-26T15:24:20.478+0000 7f387bebb700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:20.778 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.774+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool stats 2020-01-26T15:24:20.778 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.774+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pool omap 2020-01-26T15:24:20.780 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.778+0000 7fbf5e765700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:20.781 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.778+0000 7fbf5e765700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2020-01-26T15:24:20.782 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.778+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: legacy statfs record found, removing 2020-01-26T15:24:20.782 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.778+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: missing Pool StatFS record for pool 2 2020-01-26T15:24:20.782 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:20.778+0000 7fbf6f50dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck error: missing Pool StatFS record for pool ffffffffffffffff 2020-01-26T15:24:21.597 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:21.594+0000 7fbf6f50dd80 -1 osd.2 20 log_to_monitors {default=true} 2020-01-26T15:24:21.600 INFO:tasks.ceph.osd.2.smithi129.stderr:2020-01-26T15:24:21.598+0000 7fbf6a1df700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:21.699 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:21.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 Processor -- start 2020-01-26T15:24:21.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 -- start start 2020-01-26T15:24:21.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 0x7fbc840a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:21.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840a6dc0 con 0x7fbc84149040 2020-01-26T15:24:21.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8405ea20 con 0x7fbc8405edd0 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc89ae5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84098000 con 0x7fbc8405e5f0 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc892e4700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbc8405edd0 0x7fbc8407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45398/0 (socket says 172.21.15.129:45398) 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc892e4700 1 -- 172.21.15.129:0/3268537762 learned_addr learned my addr 172.21.15.129:0/3268537762 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc88ae3700 -1 --2- 172.21.15.129:0/3268537762 >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 0x7fbc840a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc8ad47700 1 --1- 172.21.15.129:0/3268537762 >> v1:172.21.15.129:6789/0 conn(0x7fbc84149040 0x7fbc8414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39486/0 (socket says 172.21.15.129:39486) 2020-01-26T15:24:21.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.802+0000 7fbc88ae3700 1 --2- 172.21.15.129:0/3268537762 >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 0x7fbc840a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207961936 0 0) 0x7fbc840a6dc0 con 0x7fbc84149040 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc70003230 con 0x7fbc84149040 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972739959 0 0) 0x7fbc8405ea20 con 0x7fbc8405edd0 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc840a6dc0 con 0x7fbc8405edd0 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 259694201 0 0) 0x7fbc70003230 con 0x7fbc84149040 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 msgr2=0x7fbc840a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 --2- 172.21.15.129:0/3268537762 >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 0x7fbc840a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:21.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 >> v1:172.21.15.129:6791/0 conn(0x7fbc8405edd0 legacy=0x7fbc8407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8405e050 con 0x7fbc84149040 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbc7c001a60 con 0x7fbc84149040 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.0 v1:172.21.15.129:6789/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fbc7c001d50 con 0x7fbc84149040 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc7bfff700 1 -- 172.21.15.129:0/3268537762 <== mon.0 v1:172.21.15.129:6789/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbc7c004870 con 0x7fbc84149040 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- 172.21.15.129:0/3268537762 >> v1:172.21.15.129:6789/0 conn(0x7fbc84149040 legacy=0x7fbc8414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- 172.21.15.129:0/3268537762 shutdown_connections 2020-01-26T15:24:21.813 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 --2- 172.21.15.129:0/3268537762 >> v2:172.21.15.129:6791/0 conn(0x7fbc8405e5f0 0x7fbc840a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:21.814 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- 172.21.15.129:0/3268537762 >> 172.21.15.129:0/3268537762 conn(0x7fbc84098e70 msgr2=0x7fbc840a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:21.814 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- 172.21.15.129:0/3268537762 shutdown_connections 2020-01-26T15:24:21.814 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- 172.21.15.129:0/3268537762 wait complete. 2020-01-26T15:24:21.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 Processor -- start 2020-01-26T15:24:21.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.806+0000 7fbc89ae5700 1 -- start start 2020-01-26T15:24:21.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 0x7fbc84099ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:21.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8409a2c0 con 0x7fbc8407cea0 2020-01-26T15:24:21.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8409e540 con 0x7fbc8407d2d0 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84120c20 con 0x7fbc8409e110 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc88ae3700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fbc8407cea0 0x7fbc840a4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39488/0 (socket says 172.21.15.129:39488) 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc88ae3700 1 -- 172.21.15.129:0/1016630737 learned_addr learned my addr 172.21.15.129:0/1016630737 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc892e4700 -1 --2- 172.21.15.129:0/1016630737 >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 0x7fbc84099ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc892e4700 1 --2- 172.21.15.129:0/1016630737 >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 0x7fbc84099ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269022889 0 0) 0x7fbc8409e540 con 0x7fbc8407d2d0 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc64003230 con 0x7fbc8407d2d0 2020-01-26T15:24:21.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719200123 0 0) 0x7fbc8409a2c0 con 0x7fbc8407cea0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc8409e540 con 0x7fbc8407cea0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3188601846 0 0) 0x7fbc64003230 con 0x7fbc8407d2d0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc8409a2c0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbc7c001cb0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2193717874 0 0) 0x7fbc8409e540 con 0x7fbc8407cea0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbc64003230 con 0x7fbc8407cea0 2020-01-26T15:24:21.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbc740026c0 con 0x7fbc8407cea0 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1514851694 0 0) 0x7fbc8409a2c0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 msgr2=0x7fbc84099ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 --2- 172.21.15.129:0/1016630737 >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 0x7fbc84099ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 >> v1:172.21.15.129:6789/0 conn(0x7fbc8407cea0 legacy=0x7fbc840a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84122f10 con 0x7fbc8407d2d0 2020-01-26T15:24:21.820 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc840a1ac0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84097990 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fbc7c004df0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fbc7c004fe0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.810+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc84056600 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.814+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fbc7c010a20 con 0x7fbc8407d2d0 2020-01-26T15:24:21.821 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.814+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 2854+0+0 (unknown 1823070332 0 0) 0x7fbc7c04bac0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.822+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fbc7c0312c0 con 0x7fbc8407d2d0 2020-01-26T15:24:21.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.930+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc8405cc60 con 0x7fbc8407d2d0 2020-01-26T15:24:21.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc79ffb700 1 -- 172.21.15.129:0/1016630737 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+8977 (unknown 3496218867 0 2960726540) 0x7fbc7c031e70 con 0x7fbc8407d2d0 2020-01-26T15:24:21.936 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:21.936 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":24,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:21.439097+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":23,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":17867}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":17867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":17867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":17867}]},"public_addr":"172.21.15.129:6805/17867","cluster_addr":"172.21.15.129:6806/17867","heartbeat_back_addr":"172.21.15.129:6808/17867","heartbeat_front_addr":"172.21.15.129:6807/17867","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":23,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":11410}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":11410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":11410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":11410}]},"public_addr":"172.21.15.129:6813/11410","cluster_addr":"172.21.15.129:6814/11410","heartbeat_back_addr":"172.21.15.129:6815/11410","heartbeat_front_addr":"172.21.15.129:6816/11410","state":["exists"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":24,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":17994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":17994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":17994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":17994}]},"public_addr":"172.21.15.129:6809/17994","cluster_addr":"172.21.15.129:6810/17994","heartbeat_back_addr":"172.21.15.129:6812/17994","heartbeat_front_addr":"172.21.15.129:6811/17994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854031667195,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 >> v1:172.21.15.129:6800/16899 conn(0x7fbc6403e470 legacy=0x7fbc64040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 >> v1:172.21.15.129:6791/0 conn(0x7fbc8407d2d0 legacy=0x7fbc840a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 shutdown_connections 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 --2- 172.21.15.129:0/1016630737 >> v2:172.21.15.129:6791/0 conn(0x7fbc8409e110 0x7fbc84099ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 >> 172.21.15.129:0/1016630737 conn(0x7fbc8405c180 msgr2=0x7fbc8407f240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:21.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 shutdown_connections 2020-01-26T15:24:21.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:21.934+0000 7fbc89ae5700 1 -- 172.21.15.129:0/1016630737 wait complete. 2020-01-26T15:24:24.951 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:25.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 Processor -- start 2020-01-26T15:24:25.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- start start 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 0x7f3bf40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 0x7f3bf414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40a6dc0 con 0x7f3bf405edd0 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf405ea20 con 0x7f3bf405e5f0 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf4098000 con 0x7f3bf4149040 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf37fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 0x7f3bf40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:25.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf37fe700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 0x7f3bf40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf3fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f3bf405edd0 0x7f3bf407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47828/0 (socket says 172.21.15.129:47828) 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf3fff700 1 -- 172.21.15.129:0/1679756944 learned_addr learned my addr 172.21.15.129:0/1679756944 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf9f26700 -1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 0x7f3bf414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf9f26700 1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 0x7f3bf414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284552617 0 0) 0x7f3bf40a6dc0 con 0x7f3bf405edd0 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc003230 con 0x7f3bf405edd0 2020-01-26T15:24:25.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1512292677 0 0) 0x7f3bdc003230 con 0x7f3bf405edd0 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 msgr2=0x7f3bf414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 0x7f3bf414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 msgr2=0x7f3bf40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 0x7f3bf40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf405e050 con 0x7f3bf405edd0 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3be40016e0 con 0x7f3bf405edd0 2020-01-26T15:24:25.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3be4001b10 con 0x7f3bf405edd0 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf2ffd700 1 -- 172.21.15.129:0/1679756944 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3be4004730 con 0x7f3bf405edd0 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/1679756944 >> v1:172.21.15.129:6790/0 conn(0x7f3bf405edd0 legacy=0x7f3bf407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/1679756944 shutdown_connections 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6791/0 conn(0x7f3bf4149040 0x7f3bf414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 --2- 172.21.15.129:0/1679756944 >> v2:172.21.15.129:6790/0 conn(0x7f3bf405e5f0 0x7f3bf40a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/1679756944 >> 172.21.15.129:0/1679756944 conn(0x7f3bf4098e70 msgr2=0x7f3bf40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:25.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/1679756944 shutdown_connections 2020-01-26T15:24:25.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.066+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/1679756944 wait complete. 2020-01-26T15:24:25.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 Processor -- start 2020-01-26T15:24:25.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- start start 2020-01-26T15:24:25.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 0x7f3bf409deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:25.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 0x7f3bf40a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:25.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf4099e30 con 0x7f3bf40a0560 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40a4450 con 0x7f3bf4099a00 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf409fb40 con 0x7f3bf409e400 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf37fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 0x7f3bf40a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf9f26700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f3bf40a0560 0x7f3bf407c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47836/0 (socket says 172.21.15.129:47836) 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf3fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 0x7f3bf409deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf9f26700 1 -- 172.21.15.129:0/123684746 learned_addr learned my addr 172.21.15.129:0/123684746 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:25.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf37fe700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 0x7f3bf40a0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf3fff700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 0x7f3bf409deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807936873 0 0) 0x7f3bec000ee0 con 0x7f3bf40a0560 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd4003230 con 0x7f3bf40a0560 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1596975067 0 0) 0x7f3bd4003230 con 0x7f3bf40a0560 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bec000ee0 con 0x7f3bf40a0560 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3bec001820 con 0x7f3bf40a0560 2020-01-26T15:24:25.080 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2287523514 0 0) 0x7f3bec000ee0 con 0x7f3bf40a0560 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 msgr2=0x7f3bf40a0010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 0x7f3bf40a0010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 msgr2=0x7f3bf409deb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 0x7f3bf409deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf409e830 con 0x7f3bf40a0560 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf409ed80 con 0x7f3bf40a0560 2020-01-26T15:24:25.081 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f3bec001cb0 con 0x7f3bf40a0560 2020-01-26T15:24:25.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf4121a50 con 0x7f3bf40a0560 2020-01-26T15:24:25.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.070+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f3bec0023f0 con 0x7f3bf40a0560 2020-01-26T15:24:25.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.074+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f3bec002670 con 0x7f3bf40a0560 2020-01-26T15:24:25.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.074+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4056600 con 0x7f3bf40a0560 2020-01-26T15:24:25.082 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.074+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 2854+0+0 (unknown 1184261625 0 0) 0x7f3bf4099e30 con 0x7f3bf40a0560 2020-01-26T15:24:25.083 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.078+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3bec0311b0 con 0x7f3bf40a0560 2020-01-26T15:24:25.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.194+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bf409a070 con 0x7f3bf40a0560 2020-01-26T15:24:25.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf0ff9700 1 -- 172.21.15.129:0/123684746 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+8984 (unknown 675718476 0 1442671453) 0x7f3bec04a900 con 0x7f3bf40a0560 2020-01-26T15:24:25.200 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:25.200 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":26,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:23.450813+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":17867}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":17867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":17867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":17867}]},"public_addr":"172.21.15.129:6805/17867","cluster_addr":"172.21.15.129:6806/17867","heartbeat_back_addr":"172.21.15.129:6808/17867","heartbeat_front_addr":"172.21.15.129:6807/17867","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":25,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":18164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":18164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":18164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":18164}]},"public_addr":"172.21.15.129:6813/18164","cluster_addr":"172.21.15.129:6814/18164","heartbeat_back_addr":"172.21.15.129:6816/18164","heartbeat_front_addr":"172.21.15.129:6815/18164","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":24,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":17994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":17994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":17994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":17994}]},"public_addr":"172.21.15.129:6809/17994","cluster_addr":"172.21.15.129:6810/17994","heartbeat_back_addr":"172.21.15.129:6812/17994","heartbeat_front_addr":"172.21.15.129:6811/17994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:25.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 >> v1:172.21.15.129:6800/16899 conn(0x7f3bd403e0d0 legacy=0x7f3bd40405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:25.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 >> v1:172.21.15.129:6790/0 conn(0x7f3bf40a0560 legacy=0x7f3bf407c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:25.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 shutdown_connections 2020-01-26T15:24:25.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6790/0 conn(0x7f3bf4099a00 0x7f3bf409deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:25.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 --2- 172.21.15.129:0/123684746 >> v2:172.21.15.129:6791/0 conn(0x7f3bf409e400 0x7f3bf40a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 >> 172.21.15.129:0/123684746 conn(0x7f3bf4098e10 msgr2=0x7f3bf4097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 shutdown_connections 2020-01-26T15:24:25.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:25.198+0000 7f3bf8cc4700 1 -- 172.21.15.129:0/123684746 wait complete. 2020-01-26T15:24:25.213 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:24:25.213 INFO:teuthology.run_tasks:Running task ceph.stop... 2020-01-26T15:24:25.227 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2020-01-26T15:24:25.227 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-01-26T15:24:25.228 INFO:teuthology.orchestra.run:waiting for 300 2020-01-26T15:24:25.244 INFO:tasks.ceph.mds.c:Stopped 2020-01-26T15:24:25.244 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2020-01-26T15:24:28.488 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2020-01-26T15:24:28.488 INFO:teuthology.run_tasks:Running task ceph.restart... 2020-01-26T15:24:28.510 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2020-01-26T15:24:28.510 INFO:tasks.ceph.mds.a:Restarting daemon 2020-01-26T15:24:28.511 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-01-26T15:24:28.513 INFO:tasks.ceph.mds.a:Started 2020-01-26T15:24:28.513 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2020-01-26T15:24:28.513 INFO:tasks.ceph.mds.c:Restarting daemon 2020-01-26T15:24:28.513 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-01-26T15:24:28.515 INFO:tasks.ceph.mds.c:Started 2020-01-26T15:24:28.516 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2020-01-26T15:24:28.516 INFO:tasks.ceph.mds.b:Restarting daemon 2020-01-26T15:24:28.516 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-01-26T15:24:28.518 INFO:tasks.ceph.mds.b:Started 2020-01-26T15:24:28.518 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:24:28.518 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:28.580 INFO:tasks.ceph.mds.c.smithi129.stderr:2020-01-26T15:24:28.578+0000 7f836105c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x5637bc4a5200 0x5637bd116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.582 INFO:tasks.ceph.mds.c.smithi129.stdout:starting mds.c at 2020-01-26T15:24:28.585 INFO:tasks.ceph.mds.b.smithi129.stderr:2020-01-26T15:24:28.582+0000 7f1b99b87700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x563e564f9200 0x563e57178000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:28.585 INFO:tasks.ceph.mds.b.smithi129.stderr:2020-01-26T15:24:28.582+0000 7f1b9a388700 -1 --2- 172.21.15.129:0/715967792 >> v2:172.21.15.129:6790/0 conn(0x563e564f9680 0x563e57178580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.586 INFO:tasks.ceph.mds.c.smithi129.stderr:2020-01-26T15:24:28.582+0000 7f836185d700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:28.588 INFO:tasks.ceph.mds.b.smithi129.stdout:starting mds.b at 2020-01-26T15:24:28.591 INFO:tasks.ceph.mds.b.smithi129.stderr:2020-01-26T15:24:28.590+0000 7f1b9a388700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:28.593 INFO:tasks.ceph.mds.a.smithi129.stderr:2020-01-26T15:24:28.590+0000 7f8bd8960700 -1 --2- 172.21.15.129:0/2813754503 >> v2:172.21.15.129:6790/0 conn(0x5562d9391200 0x5562da002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.595 INFO:tasks.ceph.mds.a.smithi129.stdout:starting mds.a at 2020-01-26T15:24:28.599 INFO:tasks.ceph.mds.a.smithi129.stderr:2020-01-26T15:24:28.598+0000 7f8bd9962700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:28.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 Processor -- start 2020-01-26T15:24:28.644 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 -- start start 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 0x7f8d0414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040a5b80 con 0x7f8d040a5750 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d04080440 con 0x7f8d04146c30 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d040a43f0 con 0x7f8d0414a880 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d03fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f8d040a5750 0x7f8d040a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47880/0 (socket says 172.21.15.129:47880) 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d03fff700 1 -- 172.21.15.129:0/2189912932 learned_addr learned my addr 172.21.15.129:0/2189912932 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:28.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d08b72700 -1 --2- 172.21.15.129:0/2189912932 >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 0x7f8d0414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d08b72700 1 --2- 172.21.15.129:0/2189912932 >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 0x7f8d0414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653886431 0 0) 0x7f8d040a5b80 con 0x7f8d040a5750 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec003230 con 0x7f8d040a5750 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415113943 0 0) 0x7f8d04080440 con 0x7f8d04146c30 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d040a5b80 con 0x7f8d04146c30 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 433530501 0 0) 0x7f8cec003230 con 0x7f8d040a5750 2020-01-26T15:24:28.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 msgr2=0x7f8d0414ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 --2- 172.21.15.129:0/2189912932 >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 0x7f8d0414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 >> v1:172.21.15.129:6791/0 conn(0x7f8d04146c30 legacy=0x7f8d04149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d040a4e00 con 0x7f8d040a5750 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8cfc001a60 con 0x7f8d040a5750 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8cfc001dd0 con 0x7f8d040a5750 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d02ffd700 1 -- 172.21.15.129:0/2189912932 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8cfc004930 con 0x7f8d040a5750 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.638+0000 7f8d09dd4700 1 -- 172.21.15.129:0/2189912932 >> v1:172.21.15.129:6790/0 conn(0x7f8d040a5750 legacy=0x7f8d040a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- 172.21.15.129:0/2189912932 shutdown_connections 2020-01-26T15:24:28.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 --2- 172.21.15.129:0/2189912932 >> v2:172.21.15.129:6790/0 conn(0x7f8d0414a880 0x7f8d0414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:28.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- 172.21.15.129:0/2189912932 >> 172.21.15.129:0/2189912932 conn(0x7f8d0405e050 msgr2=0x7f8d04098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:28.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- 172.21.15.129:0/2189912932 shutdown_connections 2020-01-26T15:24:28.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- 172.21.15.129:0/2189912932 wait complete. 2020-01-26T15:24:28.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 Processor -- start 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- start start 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 0x7f8d04093290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d04092470 con 0x7f8d041368d0 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d04092780 con 0x7f8d04095e90 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d09dd4700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8d04066120 con 0x7f8d040941b0 2020-01-26T15:24:28.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d037fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f8d04095e90 0x7f8d040962c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45504/0 (socket says 172.21.15.129:45504) 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d03fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 0x7f8d04093290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.642+0000 7f8d037fe700 1 -- 172.21.15.129:0/765624916 learned_addr learned my addr 172.21.15.129:0/765624916 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d03fff700 1 --2- 172.21.15.129:0/765624916 >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 0x7f8d04093290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669907516 0 0) 0x7f8d04092780 con 0x7f8d04095e90 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce4003230 con 0x7f8d04095e90 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947719822 0 0) 0x7f8d04092470 con 0x7f8d041368d0 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d04092780 con 0x7f8d041368d0 2020-01-26T15:24:28.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1027132162 0 0) 0x7f8d04092780 con 0x7f8d041368d0 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d04092470 con 0x7f8d041368d0 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8cf4001630 con 0x7f8d041368d0 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2428599087 0 0) 0x7f8ce4003230 con 0x7f8d04095e90 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d04092780 con 0x7f8d04095e90 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8cf8002890 con 0x7f8d04095e90 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3410434960 0 0) 0x7f8d04092470 con 0x7f8d041368d0 2020-01-26T15:24:28.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 msgr2=0x7f8d04093290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 --2- 172.21.15.129:0/765624916 >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 0x7f8d04093290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 >> v1:172.21.15.129:6791/0 conn(0x7f8d04095e90 legacy=0x7f8d040962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0407fc20 con 0x7f8d041368d0 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d040950b0 con 0x7f8d041368d0 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d04065ba0 con 0x7f8d041368d0 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f8cf4001ec0 con 0x7f8d041368d0 2020-01-26T15:24:28.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7f8cf40022b0 con 0x7f8d041368d0 2020-01-26T15:24:28.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc003360 con 0x7f8d041368d0 2020-01-26T15:24:28.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f8cf4002530 con 0x7f8d041368d0 2020-01-26T15:24:28.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.646+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 8 ==== osd_map(27..27 src has 1..27) v4 ==== 2897+0+0 (unknown 138721796 0 0) 0x7f8cf404b880 con 0x7f8d041368d0 2020-01-26T15:24:28.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.654+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8cf4030f80 con 0x7f8d041368d0 2020-01-26T15:24:28.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.770+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 --> v1:172.21.15.129:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cdc0021f0 con 0x7f8d041368d0 2020-01-26T15:24:28.776 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.774+0000 7f8d00ff9700 1 -- 172.21.15.129:0/765624916 <== mon.0 v1:172.21.15.129:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+9053 (unknown 3600925931 0 3234630054) 0x7f8cf404a730 con 0x7f8d041368d0 2020-01-26T15:24:28.776 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:28.776 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":27,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:28.612805+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs","flags_num":1605632,"flags_set":["purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"mimic","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":17867}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":17867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":17867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":17867}]},"public_addr":"172.21.15.129:6805/17867","cluster_addr":"172.21.15.129:6806/17867","heartbeat_back_addr":"172.21.15.129:6808/17867","heartbeat_front_addr":"172.21.15.129:6807/17867","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":25,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":18164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":18164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":18164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":18164}]},"public_addr":"172.21.15.129:6813/18164","cluster_addr":"172.21.15.129:6814/18164","heartbeat_back_addr":"172.21.15.129:6816/18164","heartbeat_front_addr":"172.21.15.129:6815/18164","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":24,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":17994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":17994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":17994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":17994}]},"public_addr":"172.21.15.129:6809/17994","cluster_addr":"172.21.15.129:6810/17994","heartbeat_back_addr":"172.21.15.129:6812/17994","heartbeat_front_addr":"172.21.15.129:6811/17994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"v1:172.21.15.129:6819/2338999715":"2020-01-27T15:24:28.612769+0000","v1:172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:28.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 >> v1:172.21.15.129:6800/16899 conn(0x7f8ce403e3e0 legacy=0x7f8ce40408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 >> v1:172.21.15.129:6789/0 conn(0x7f8d041368d0 legacy=0x7f8d04138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 shutdown_connections 2020-01-26T15:24:28.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 --2- 172.21.15.129:0/765624916 >> v2:172.21.15.129:6790/0 conn(0x7f8d040941b0 0x7f8d04093290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:28.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 >> 172.21.15.129:0/765624916 conn(0x7f8d040a4110 msgr2=0x7f8d040a0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:28.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 shutdown_connections 2020-01-26T15:24:28.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.778+0000 7f8d09dd4700 1 -- 172.21.15.129:0/765624916 wait complete. 2020-01-26T15:24:28.796 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:24:28.796 INFO:teuthology.run_tasks:Running task exec... 2020-01-26T15:24:28.811 INFO:teuthology.task.exec:Executing custom commands... 2020-01-26T15:24:28.811 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi129.front.sepia.ceph.com 2020-01-26T15:24:28.811 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mon enable-msgr2' 2020-01-26T15:24:28.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 Processor -- start 2020-01-26T15:24:28.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- start start 2020-01-26T15:24:28.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 0x7fa504060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:28.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040a7a60 con 0x7fa50405f5a0 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50414d6f0 con 0x7fa504065e30 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa504065bd0 con 0x7fa504097720 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5037fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 0x7fa504060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5037fe700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 0x7fa504060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa509c3f700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fa50405f5a0 0x7fa5040a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47894/0 (socket says 172.21.15.129:47894) 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa509c3f700 1 -- 172.21.15.129:0/1814628080 learned_addr learned my addr 172.21.15.129:0/1814628080 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:28.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa503fff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fa504065e30 0x7fa504144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45510/0 (socket says 172.21.15.129:45510) 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709962129 0 0) 0x7fa5040a7a60 con 0x7fa50405f5a0 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003230 con 0x7fa50405f5a0 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691698066 0 0) 0x7fa50414d6f0 con 0x7fa504065e30 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5040a7a60 con 0x7fa504065e30 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3811938545 0 0) 0x7fa4f0003230 con 0x7fa50405f5a0 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 msgr2=0x7fa504060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:28.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 --2- 172.21.15.129:0/1814628080 >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 0x7fa504060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 >> v1:172.21.15.129:6791/0 conn(0x7fa504065e30 legacy=0x7fa504144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504145160 con 0x7fa50405f5a0 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa4fc001a60 con 0x7fa50405f5a0 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa4fc001d00 con 0x7fa50405f5a0 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa502ffd700 1 -- 172.21.15.129:0/1814628080 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa4fc004930 con 0x7fa50405f5a0 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- 172.21.15.129:0/1814628080 >> v1:172.21.15.129:6790/0 conn(0x7fa50405f5a0 legacy=0x7fa5040a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:28.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- 172.21.15.129:0/1814628080 shutdown_connections 2020-01-26T15:24:28.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 --2- 172.21.15.129:0/1814628080 >> v2:172.21.15.129:6790/0 conn(0x7fa504097720 0x7fa504060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:28.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- 172.21.15.129:0/1814628080 >> 172.21.15.129:0/1814628080 conn(0x7fa504060030 msgr2=0x7fa50405e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:28.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- 172.21.15.129:0/1814628080 shutdown_connections 2020-01-26T15:24:28.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.918+0000 7fa5089dd700 1 -- 172.21.15.129:0/1814628080 wait complete. 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 Processor -- start 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 -- start start 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 0x7fa504147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 0x7fa5040a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa504146b30 con 0x7fa5040a6380 2020-01-26T15:24:28.930 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa504148250 con 0x7fa504146e00 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5089dd700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa5041484f0 con 0x7fa5040a5a00 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa503fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 0x7fa504147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa503fff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 0x7fa504147b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa509c3f700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fa5040a6380 0x7fa504079b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45520/0 (socket says 172.21.15.129:45520) 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa509c3f700 1 -- 172.21.15.129:0/3165562752 learned_addr learned my addr 172.21.15.129:0/3165562752 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5037fe700 -1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 0x7fa5040a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:28.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.922+0000 7fa5037fe700 1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 0x7fa5040a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587340845 0 0) 0x7fa504146b30 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e8003230 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4003674257 0 0) 0x7fa4e8003230 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa504146b30 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa4fc001bb0 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2483025594 0 0) 0x7fa504146b30 con 0x7fa5040a6380 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 msgr2=0x7fa5040a5e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:28.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 0x7fa5040a5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 msgr2=0x7fa504147b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 0x7fa504147b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504060020 con 0x7fa5040a6380 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040a67b0 con 0x7fa5040a6380 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa504064890 con 0x7fa5040a6380 2020-01-26T15:24:28.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fa4fc004c00 con 0x7fa5040a6380 2020-01-26T15:24:28.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 278+0+0 (unknown 1722682423 0 0) 0x7fa4fc005030 con 0x7fa5040a6380 2020-01-26T15:24:28.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fa4fc010a70 con 0x7fa5040a6380 2020-01-26T15:24:28.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(27..27 src has 1..27) v4 ==== 2897+0+0 (unknown 138721796 0 0) 0x7fa4fc04bb70 con 0x7fa5040a6380 2020-01-26T15:24:28.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.926+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa504056600 con 0x7fa5040a6380 2020-01-26T15:24:28.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:28.930+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fa504145160 con 0x7fa5040a6380 2020-01-26T15:24:29.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.086+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "mon enable-msgr2"} v 0) v1 -- 0x7fa50405ee20 con 0x7fa5040a6380 2020-01-26T15:24:29.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.086+0000 7fa500ff9700 1 -- 172.21.15.129:0/3165562752 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "mon enable-msgr2"}]=0 v2) v1 ==== 64+0+0 (unknown 626962205 0 0) 0x7fa4fc031080 con 0x7fa5040a6380 2020-01-26T15:24:29.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.086+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 >> v1:172.21.15.129:6800/16899 conn(0x7fa4e803e120 legacy=0x7fa4e8040630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.086+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 >> v1:172.21.15.129:6791/0 conn(0x7fa5040a6380 legacy=0x7fa504079b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 shutdown_connections 2020-01-26T15:24:29.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6790/0 conn(0x7fa504146e00 0x7fa504147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 --2- 172.21.15.129:0/3165562752 >> v2:172.21.15.129:6791/0 conn(0x7fa5040a5a00 0x7fa5040a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 >> 172.21.15.129:0/3165562752 conn(0x7fa504025520 msgr2=0x7fa50407aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 shutdown_connections 2020-01-26T15:24:29.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.094+0000 7fa5089dd700 1 -- 172.21.15.129:0/3165562752 wait complete. 2020-01-26T15:24:29.107 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2020-01-26T15:24:29.201 INFO:tasks.ceph.mon.a.smithi129.stderr:2020-01-26T15:24:29.198+0000 7f8b396f0700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.210+0000 7fdc21834700 1 Processor -- start 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.210+0000 7fdc21834700 1 -- start start 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc21834700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 0x7fdc1c060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc21834700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c0a7a60 con 0x7fdc1c065e30 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc21834700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c14d6f0 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc21834700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c065bd0 con 0x7fdc1c097720 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc22a96700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdc1c05f5a0 0x7fdc1c0a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45584/0 (socket says 172.21.15.129:45584) 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc22a96700 1 -- 172.21.15.129:0/3654395776 learned_addr learned my addr 172.21.15.129:0/3654395776 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc20832700 -1 --2- 172.21.15.129:0/3654395776 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 0x7fdc1c060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.214+0000 7fdc20832700 1 --2- 172.21.15.129:0/3654395776 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 0x7fdc1c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035211363 0 0) 0x7fdc1c14d6f0 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc08003230 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644560044 0 0) 0x7fdc1c0a7a60 con 0x7fdc1c065e30 2020-01-26T15:24:29.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c14d6f0 con 0x7fdc1c065e30 2020-01-26T15:24:29.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2352905498 0 0) 0x7fdc08003230 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 msgr2=0x7fdc1c060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:29.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 --2- 172.21.15.129:0/3654395776 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 0x7fdc1c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 >> v1:172.21.15.129:6790/0 conn(0x7fdc1c065e30 legacy=0x7fdc1c144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c145160 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.218+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdc14001a90 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fdc14001d30 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc13fff700 1 -- 172.21.15.129:0/3654395776 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdc14004930 con 0x7fdc1c05f5a0 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- 172.21.15.129:0/3654395776 >> v1:172.21.15.129:6791/0 conn(0x7fdc1c05f5a0 legacy=0x7fdc1c0a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- 172.21.15.129:0/3654395776 shutdown_connections 2020-01-26T15:24:29.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 --2- 172.21.15.129:0/3654395776 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c097720 0x7fdc1c060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- 172.21.15.129:0/3654395776 >> 172.21.15.129:0/3654395776 conn(0x7fdc1c060030 msgr2=0x7fdc1c05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- 172.21.15.129:0/3654395776 shutdown_connections 2020-01-26T15:24:29.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- 172.21.15.129:0/3654395776 wait complete. 2020-01-26T15:24:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 Processor -- start 2020-01-26T15:24:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- start start 2020-01-26T15:24:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdc1c079b80 0x7fdc1c079fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c0252d0 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c07a930 con 0x7fdc1c07a500 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc21834700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0a6170 con 0x7fdc1c079b80 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc22a96700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdc1c07a500 0x7fdc1c131710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45600/0 (socket says 172.21.15.129:45600) 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc20832700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdc1c079b80 0x7fdc1c079fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc22a96700 1 -- 172.21.15.129:0/422185097 learned_addr learned my addr 172.21.15.129:0/422185097 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c079b80 0x7fdc1c079fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036681026 0 0) 0x7fdc1c07a930 con 0x7fdc1c07a500 2020-01-26T15:24:29.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc003230 con 0x7fdc1c07a500 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058682376 0 0) 0x7fdc1c0252d0 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c07a930 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3628995223 0 0) 0x7fdbfc003230 con 0x7fdc1c07a500 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdc1c0252d0 con 0x7fdc1c07a500 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdc14001bb0 con 0x7fdc1c07a500 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 381928105 0 0) 0x7fdc1c07a930 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbfc003230 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.222+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdc18001790 con 0x7fdc1c0a5d40 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c079b80 msgr2=0x7fdc1c079fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 --2- 172.21.15.129:0/422185097 >> v2:172.21.15.129:6790/0 conn(0x7fdc1c079b80 0x7fdc1c079fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 >> v1:172.21.15.129:6791/0 conn(0x7fdc1c07a500 legacy=0x7fdc1c131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 >> v1:172.21.15.129:6789/0 conn(0x7fdc1c0a5d40 legacy=0x7fdc1c063c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdc1c07a930 con 0x7fdbfc00ad40 2020-01-26T15:24:29.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdbfc004240 con 0x7fdbfc004f00 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0a6170 con 0x7fdbfc003d40 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356628912 0 0) 0x7fdbfc004240 con 0x7fdbfc004f00 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbfc00f9a0 con 0x7fdbfc004f00 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523667312 0 0) 0x7fdc1c07a930 con 0x7fdbfc00ad40 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 -- 172.21.15.129:0/422185097 >> v1:172.21.15.129:6791/0 conn(0x7fdbfc004f00 legacy=0x7fdbfc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 -- 172.21.15.129:0/422185097 >> v1:172.21.15.129:6790/0 conn(0x7fdbfc00ad40 legacy=0x7fdbfc00d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fdc1c024cc0 con 0x7fdbfc003d40 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c063180 con 0x7fdbfc003d40 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c064400 con 0x7fdbfc003d40 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fdc0c008af0 con 0x7fdbfc003d40 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fdc0c008cf0 con 0x7fdbfc003d40 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fdc0c005780 con 0x7fdbfc003d40 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4003360 con 0x7fdbfc003d40 2020-01-26T15:24:29.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.226+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (secure 0 0 0) 0x7fdc0c04ccb0 con 0x7fdbfc003d40 2020-01-26T15:24:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.230+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.230+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fdc0c032d90 con 0x7fdbfc003d40 2020-01-26T15:24:29.386 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.382+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbf40037a0 con 0x7fdbfc003d40 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.382+0000 7fdc20832700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.382+0000 7fdc11ffb700 1 -- 172.21.15.129:0/422185097 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fdc0c032ff0 con 0x7fdbfc003d40 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stdout: "mon": { 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 3 2020-01-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: "mgr": { 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 2 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": { 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 4 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.388 INFO:teuthology.orchestra.run.smithi129.stdout: "mds": { 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 2 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout: "overall": { 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev)": 11 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.389 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:24:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 >> v1:172.21.15.129:6800/16899 conn(0x7fdbfc048790 legacy=0x7fdbfc04aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 msgr2=0x7fdbfc00a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.390 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 --2- 172.21.15.129:0/422185097 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbfc003d40 0x7fdbfc00a7f0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7fdc0c002f30 tx=0x7fdc0c010af0).stop 2020-01-26T15:24:29.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc22a96700 1 -- 172.21.15.129:0/422185097 reap_dead start 2020-01-26T15:24:29.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 shutdown_connections 2020-01-26T15:24:29.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 >> 172.21.15.129:0/422185097 conn(0x7fdc1c07fcf0 msgr2=0x7fdc1c07ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 shutdown_connections 2020-01-26T15:24:29.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.386+0000 7fdc21834700 1 -- 172.21.15.129:0/422185097 wait complete. 2020-01-26T15:24:29.400 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2020-01-26T15:24:29.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 Processor -- start 2020-01-26T15:24:29.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- start start 2020-01-26T15:24:29.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 0x7f1f84060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:29.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f840a7a60 con 0x7f1f8405f5a0 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8414d6f0 con 0x7f1f84097720 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1f84065bd0 con 0x7f1f84065e30 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f899d2700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 0x7f1f84060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8b435700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1f8405f5a0 0x7f1f840a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:47996/0 (socket says 172.21.15.129:47996) 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8b435700 1 -- 172.21.15.129:0/1385150106 learned_addr learned my addr 172.21.15.129:0/1385150106 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f899d2700 1 --2- 172.21.15.129:0/1385150106 >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 0x7f1f84060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078364329 0 0) 0x7f1f840a7a60 con 0x7f1f8405f5a0 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f70003230 con 0x7f1f8405f5a0 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238174967 0 0) 0x7f1f8414d6f0 con 0x7f1f84097720 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f840a7a60 con 0x7f1f84097720 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3315868810 0 0) 0x7f1f70003230 con 0x7f1f8405f5a0 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 msgr2=0x7f1f84060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 --2- 172.21.15.129:0/1385150106 >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 0x7f1f84060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 >> v1:172.21.15.129:6791/0 conn(0x7f1f84097720 legacy=0x7f1f84144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84145160 con 0x7f1f8405f5a0 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f7c001a90 con 0x7f1f8405f5a0 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7f1f7c001e00 con 0x7f1f8405f5a0 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f889d0700 1 -- 172.21.15.129:0/1385150106 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f7c004ae0 con 0x7f1f8405f5a0 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/1385150106 >> v1:172.21.15.129:6790/0 conn(0x7f1f8405f5a0 legacy=0x7f1f840a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/1385150106 shutdown_connections 2020-01-26T15:24:29.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 --2- 172.21.15.129:0/1385150106 >> v2:172.21.15.129:6790/0 conn(0x7f1f84065e30 0x7f1f84060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/1385150106 >> 172.21.15.129:0/1385150106 conn(0x7f1f84060030 msgr2=0x7f1f8405e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/1385150106 shutdown_connections 2020-01-26T15:24:29.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.506+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/1385150106 wait complete. 2020-01-26T15:24:29.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 Processor -- start 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 -- start start 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1f84061580 0x7f1f841325d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f84132b20 0x7f1f84132f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f84094170 con 0x7f1f84061070 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1f840619b0 con 0x7f1f84132b20 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8a1d3700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1f84025120 con 0x7f1f84061580 2020-01-26T15:24:29.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8b435700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f84132b20 0x7f1f84132f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f8b435700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f84132b20 0x7f1f84132f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f891d1700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1f84061580 0x7f1f841325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f899d2700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f1f84061070 0x7f1f84093970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39702/0 (socket says 172.21.15.129:39702) 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f899d2700 1 -- 172.21.15.129:0/2970581490 learned_addr learned my addr 172.21.15.129:0/2970581490 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> v2:172.21.15.129:6791/0 conn(0x7f1f84061580 0x7f1f841325d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983598317 0 0) 0x7f1f84094170 con 0x7f1f84061070 2020-01-26T15:24:29.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c003230 con 0x7f1f84061070 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2634553791 0 0) 0x7f1f6c003230 con 0x7f1f84061070 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f84094170 con 0x7f1f84061070 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f80002780 con 0x7f1f84061070 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 >> v2:172.21.15.129:6791/0 conn(0x7f1f84061580 msgr2=0x7f1f841325d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 --2- 172.21.15.129:0/2970581490 >> v2:172.21.15.129:6791/0 conn(0x7f1f84061580 0x7f1f841325d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 >> v2:172.21.15.129:6790/0 conn(0x7f1f84132b20 msgr2=0x7f1f84132f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:29.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 --2- 172.21.15.129:0/2970581490 >> v2:172.21.15.129:6790/0 conn(0x7f1f84132b20 0x7f1f84132f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 >> v1:172.21.15.129:6789/0 conn(0x7f1f84061070 legacy=0x7f1f84093970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f6c003230 con 0x7f1f6c00a7f0 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1f6c00f450 con 0x7f1f6c003aa0 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f840619b0 con 0x7f1f6c003ef0 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215329909 0 0) 0x7f1f6c00f450 con 0x7f1f6c003aa0 2020-01-26T15:24:29.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c00e440 con 0x7f1f6c003aa0 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477846209 0 0) 0x7f1f6c003230 con 0x7f1f6c00a7f0 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c00f450 con 0x7f1f6c00a7f0 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f891d1700 1 -- 172.21.15.129:0/2970581490 >> v1:172.21.15.129:6791/0 conn(0x7f1f6c003aa0 legacy=0x7f1f6c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.510+0000 7f1f891d1700 1 -- 172.21.15.129:0/2970581490 >> v1:172.21.15.129:6790/0 conn(0x7f1f6c00a7f0 legacy=0x7f1f6c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2545458410 0 0) 0x7f1f6c00f450 con 0x7f1f6c00a7f0 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f8b435700 1 -- 172.21.15.129:0/2970581490 reap_dead start 2020-01-26T15:24:29.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84094c70 con 0x7f1f6c003ef0 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f84099c20 con 0x7f1f6c003ef0 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f84061070 con 0x7f1f6c003ef0 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1f7c004a20 con 0x7f1f6c003ef0 2020-01-26T15:24:29.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7f1f74006990 con 0x7f1f6c003ef0 2020-01-26T15:24:29.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1f74006d30 con 0x7f1f6c003ef0 2020-01-26T15:24:29.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60003360 con 0x7f1f6c003ef0 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1f7400b3e0 con 0x7f1f6c003ef0 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.514+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (secure 0 0 0) 0x7f1f7404d4b0 con 0x7f1f6c003ef0 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.522+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.522+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1f74033860 con 0x7f1f6c003ef0 2020-01-26T15:24:29.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.638+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1f600021f0 con 0x7f1f6c003ef0 2020-01-26T15:24:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.638+0000 7f1f891d1700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.643 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.638+0000 7f1f7a7fc700 1 -- 172.21.15.129:0/2970581490 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v28) v1 ==== 81+0+17109 (secure 0 0 0) 0x7f1f7400bce0 con 0x7f1f6c003ef0 2020-01-26T15:24:29.643 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:29.643 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "epoch": 28, 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "fsid": "bb47bc39-5bc5-4332-898b-6fff3a2e822b", 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "created": "2020-01-26T15:21:30.833373+0000", 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "modified": "2020-01-26T15:24:29.151567+0000", 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "last_up_change": "0.000000", 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "last_in_change": "0.000000", 2020-01-26T15:24:29.644 INFO:teuthology.orchestra.run.smithi129.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs", 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "flags_num": 1605632, 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "flags_set": [ 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "purged_snapdirs", 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "recovery_deletes", 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "sortbitwise" 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2020-01-26T15:24:29.645 INFO:teuthology.orchestra.run.smithi129.stdout: "crush_version": 4, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "full_ratio": 0.94999998807907104, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "nearfull_ratio": 0.85000002384185791, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_snapshot": "", 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_max": 3, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "max_osd": 4, 2020-01-26T15:24:29.646 INFO:teuthology.orchestra.run.smithi129.stdout: "require_min_compat_client": "mimic", 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "min_compat_client": "jewel", 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "require_osd_release": "mimic", 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "pools": [ 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "pool": 1, 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_name": "rbd", 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "create_time": "2020-01-26T15:21:40.257840+0000", 2020-01-26T15:24:29.647 INFO:teuthology.orchestra.run.smithi129.stdout: "flags": 1, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "flags_names": "hashpspool", 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "type": 1, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 2, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "min_size": 1, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "crush_rule": 0, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "object_hash": 2, 2020-01-26T15:24:29.648 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num": 8, 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num": 8, 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num_target": 8, 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_target": 8, 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_pending": 8, 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "last_pg_merge_meta": { 2020-01-26T15:24:29.649 INFO:teuthology.orchestra.run.smithi129.stdout: "source_pgid": "0.0", 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "ready_epoch": 0, 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_started": 0, 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_clean": 0, 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "source_version": "0'0", 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "target_version": "0'0" 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.650 INFO:teuthology.orchestra.run.smithi129.stdout: "last_change": "11", 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend": "0", 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "auid": 0, 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_seq": 0, 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_epoch": 0, 2020-01-26T15:24:29.651 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_snaps": [], 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "removed_snaps": "[]", 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_bytes": 0, 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_objects": 0, 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "tiers": [], 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "tier_of": -1, 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "read_tier": -1, 2020-01-26T15:24:29.652 INFO:teuthology.orchestra.run.smithi129.stdout: "write_tier": -1, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_mode": "none", 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_bytes": 0, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_objects": 0, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_flush_age": 0, 2020-01-26T15:24:29.653 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_evict_age": 0, 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "erasure_code_profile": "", 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_params": { 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "none" 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_period": 0, 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_count": 0, 2020-01-26T15:24:29.654 INFO:teuthology.orchestra.run.smithi129.stdout: "use_gmt_hitset": true, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "grade_table": [], 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "stripe_width": 0, 2020-01-26T15:24:29.655 INFO:teuthology.orchestra.run.smithi129.stdout: "expected_num_objects": 0, 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "fast_read": false, 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "options": {}, 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "application_metadata": { 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "rbd": {} 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.656 INFO:teuthology.orchestra.run.smithi129.stdout: "pool": 2, 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_name": "cephfs_metadata", 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "create_time": "2020-01-26T15:21:42.851862+0000", 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "flags": 1, 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "flags_names": "hashpspool", 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "type": 1, 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 2, 2020-01-26T15:24:29.657 INFO:teuthology.orchestra.run.smithi129.stdout: "min_size": 1, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "crush_rule": 0, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "object_hash": 2, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num": 8, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num": 8, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num_target": 8, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_target": 8, 2020-01-26T15:24:29.658 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_pending": 8, 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "last_pg_merge_meta": { 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "source_pgid": "0.0", 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "ready_epoch": 0, 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_started": 0, 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_clean": 0, 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "source_version": "0'0", 2020-01-26T15:24:29.659 INFO:teuthology.orchestra.run.smithi129.stdout: "target_version": "0'0" 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "last_change": "14", 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend": "0", 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "auid": 0, 2020-01-26T15:24:29.660 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_seq": 0, 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_epoch": 0, 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_snaps": [], 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "removed_snaps": "[]", 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_bytes": 0, 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_objects": 0, 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "tiers": [], 2020-01-26T15:24:29.661 INFO:teuthology.orchestra.run.smithi129.stdout: "tier_of": -1, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "read_tier": -1, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "write_tier": -1, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_mode": "none", 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_bytes": 0, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_objects": 0, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:24:29.662 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_flush_age": 0, 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_evict_age": 0, 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "erasure_code_profile": "", 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_params": { 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "none" 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.663 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_period": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_count": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "use_gmt_hitset": true, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:24:29.664 INFO:teuthology.orchestra.run.smithi129.stdout: "grade_table": [], 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "stripe_width": 0, 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "expected_num_objects": 0, 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "fast_read": false, 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "options": {}, 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "application_metadata": { 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "cephfs": { 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: "metadata": "cephfs" 2020-01-26T15:24:29.665 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "pool": 3, 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_name": "cephfs_data", 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "create_time": "2020-01-26T15:21:43.236142+0000", 2020-01-26T15:24:29.666 INFO:teuthology.orchestra.run.smithi129.stdout: "flags": 1, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "flags_names": "hashpspool", 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "type": 1, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "size": 2, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "min_size": 1, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "crush_rule": 0, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "object_hash": 2, 2020-01-26T15:24:29.667 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_autoscale_mode": "warn", 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num": 8, 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num": 8, 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_placement_num_target": 8, 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_target": 8, 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_num_pending": 8, 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "last_pg_merge_meta": { 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "source_pgid": "0.0", 2020-01-26T15:24:29.668 INFO:teuthology.orchestra.run.smithi129.stdout: "ready_epoch": 0, 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_started": 0, 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "last_epoch_clean": 0, 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "source_version": "0'0", 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "target_version": "0'0" 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "last_change": "14", 2020-01-26T15:24:29.669 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend": "0", 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_prenautilus": "0", 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "last_force_op_resend_preluminous": "0", 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "auid": 0, 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_mode": "selfmanaged", 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_seq": 0, 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "snap_epoch": 0, 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "pool_snaps": [], 2020-01-26T15:24:29.670 INFO:teuthology.orchestra.run.smithi129.stdout: "removed_snaps": "[]", 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_bytes": 0, 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "quota_max_objects": 0, 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "tiers": [], 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "tier_of": -1, 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "read_tier": -1, 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "write_tier": -1, 2020-01-26T15:24:29.671 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_mode": "none", 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_bytes": 0, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "target_max_objects": 0, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_target_full_ratio_micro": 800000, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_flush_age": 0, 2020-01-26T15:24:29.672 INFO:teuthology.orchestra.run.smithi129.stdout: "cache_min_evict_age": 0, 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "erasure_code_profile": "", 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_params": { 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "none" 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_period": 0, 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_count": 0, 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "use_gmt_hitset": true, 2020-01-26T15:24:29.673 INFO:teuthology.orchestra.run.smithi129.stdout: "min_read_recency_for_promote": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "min_write_recency_for_promote": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_grade_decay_rate": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "hit_set_search_last_n": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "grade_table": [], 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "stripe_width": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "expected_num_objects": 0, 2020-01-26T15:24:29.674 INFO:teuthology.orchestra.run.smithi129.stdout: "fast_read": false, 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "options": {}, 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "application_metadata": { 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "cephfs": { 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: "data": "cephfs" 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.675 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "osds": [ 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 0, 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "uuid": "862905c0-6fd6-4e29-8d20-a16d92e67224", 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "up": 1, 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "in": 1, 2020-01-26T15:24:29.676 INFO:teuthology.orchestra.run.smithi129.stdout: "weight": 1, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "primary_affinity": 1, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_begin": 9, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_end": 17, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "up_from": 23, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "up_thru": 25, 2020-01-26T15:24:29.677 INFO:teuthology.orchestra.run.smithi129.stdout: "down_at": 19, 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "lost_at": 0, 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addrs": { 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6805", 2020-01-26T15:24:29.678 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17867 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addrs": { 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.679 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6806", 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17867 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addrs": { 2020-01-26T15:24:29.680 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6808", 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17867 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.681 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addrs": { 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6807", 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17867 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.682 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addr": "172.21.15.129:6805/17867", 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addr": "172.21.15.129:6806/17867", 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addr": "172.21.15.129:6808/17867", 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addr": "172.21.15.129:6807/17867", 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "state": [ 2020-01-26T15:24:29.683 INFO:teuthology.orchestra.run.smithi129.stdout: "exists", 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "up" 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 1, 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "uuid": "5366828c-d7f2-45d2-a018-d90c71b3d22a", 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "up": 1, 2020-01-26T15:24:29.684 INFO:teuthology.orchestra.run.smithi129.stdout: "in": 1, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "weight": 1, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "primary_affinity": 1, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_begin": 9, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_end": 17, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "up_from": 21, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "up_thru": 25, 2020-01-26T15:24:29.685 INFO:teuthology.orchestra.run.smithi129.stdout: "down_at": 18, 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "lost_at": 0, 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addrs": { 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6801", 2020-01-26T15:24:29.686 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17786 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addrs": { 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.687 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6802", 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17786 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addrs": { 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.688 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6804", 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17786 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.689 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addrs": { 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6803", 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17786 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.690 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addr": "172.21.15.129:6801/17786", 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addr": "172.21.15.129:6802/17786", 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addr": "172.21.15.129:6804/17786", 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addr": "172.21.15.129:6803/17786", 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "state": [ 2020-01-26T15:24:29.691 INFO:teuthology.orchestra.run.smithi129.stdout: "exists", 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "up" 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 2, 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "uuid": "a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9", 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "up": 1, 2020-01-26T15:24:29.692 INFO:teuthology.orchestra.run.smithi129.stdout: "in": 1, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "weight": 1, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "primary_affinity": 1, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_begin": 9, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_end": 20, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "up_from": 25, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "up_thru": 25, 2020-01-26T15:24:29.693 INFO:teuthology.orchestra.run.smithi129.stdout: "down_at": 21, 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "lost_at": 0, 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addrs": { 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6813", 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 18164 2020-01-26T15:24:29.694 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addrs": { 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.695 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6814", 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 18164 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addrs": { 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.696 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6816", 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 18164 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addrs": { 2020-01-26T15:24:29.697 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6815", 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 18164 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.698 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addr": "172.21.15.129:6813/18164", 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addr": "172.21.15.129:6814/18164", 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addr": "172.21.15.129:6816/18164", 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addr": "172.21.15.129:6815/18164", 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "state": [ 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "exists", 2020-01-26T15:24:29.699 INFO:teuthology.orchestra.run.smithi129.stdout: "up" 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 3, 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "uuid": "e13a3b22-4e52-4be6-b486-20cdf0ee7cbf", 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "up": 1, 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "in": 1, 2020-01-26T15:24:29.700 INFO:teuthology.orchestra.run.smithi129.stdout: "weight": 1, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "primary_affinity": 1, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_begin": 9, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "last_clean_end": 19, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "up_from": 24, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "up_thru": 25, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "down_at": 20, 2020-01-26T15:24:29.701 INFO:teuthology.orchestra.run.smithi129.stdout: "lost_at": 0, 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addrs": { 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6809", 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17994 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.702 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addrs": { 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6810", 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17994 2020-01-26T15:24:29.703 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addrs": { 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.704 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6812", 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17994 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addrs": { 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "addrvec": [ 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.705 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:6811", 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 17994 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "public_addr": "172.21.15.129:6809/17994", 2020-01-26T15:24:29.706 INFO:teuthology.orchestra.run.smithi129.stdout: "cluster_addr": "172.21.15.129:6810/17994", 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_back_addr": "172.21.15.129:6812/17994", 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "heartbeat_front_addr": "172.21.15.129:6811/17994", 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "state": [ 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "exists", 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: "up" 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: ] 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.707 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_xinfo": [ 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 0, 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "down_stamp": "0.000000", 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_probability": 0, 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_interval": 0, 2020-01-26T15:24:29.708 INFO:teuthology.orchestra.run.smithi129.stdout: "features": 4540138292836696063, 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "old_weight": 0, 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "dead_epoch": 0 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 1, 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "down_stamp": "0.000000", 2020-01-26T15:24:29.709 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_probability": 0, 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_interval": 0, 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "features": 4540138292836696063, 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "old_weight": 0, 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: "dead_epoch": 0 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.710 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 2, 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "down_stamp": "2020-01-26T15:24:18.422803+0000", 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_probability": 0, 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_interval": 0, 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "features": 4540138292836696063, 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "old_weight": 0, 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:24:29.711 INFO:teuthology.orchestra.run.smithi129.stdout: "dead_epoch": 0 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: { 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "osd": 3, 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "down_stamp": "0.000000", 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_probability": 0, 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "laggy_interval": 0, 2020-01-26T15:24:29.712 INFO:teuthology.orchestra.run.smithi129.stdout: "features": 4540138292836696063, 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "old_weight": 0, 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "last_purged_snaps_scrub": "0.000000", 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "dead_epoch": 0 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: ], 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_upmap": [], 2020-01-26T15:24:29.713 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_upmap_items": [], 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "pg_temp": [], 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "primary_temp": [], 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "blacklist": { 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "v1:172.21.15.129:6800/11038": "2020-01-27T15:24:08.608968+0000", 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "v1:172.21.15.129:6819/2338999715": "2020-01-27T15:24:28.612769+0000" 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "erasure_code_profiles": { 2020-01-26T15:24:29.714 INFO:teuthology.orchestra.run.smithi129.stdout: "default": { 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "crush-failure-domain": "osd", 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "k": "2", 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "m": "1", 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "plugin": "jerasure", 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "ruleset-failure-domain": "osd", 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: "technique": "reed_sol_van" 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: } 2020-01-26T15:24:29.715 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "removed_snaps_queue": [], 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "new_removed_snaps": [], 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "new_purged_snaps": [], 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "crush_node_flags": {}, 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout: "device_class_flags": {} 2020-01-26T15:24:29.716 INFO:teuthology.orchestra.run.smithi129.stdout:} 2020-01-26T15:24:29.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 >> v1:172.21.15.129:6800/16899 conn(0x7f1f6c040ce0 legacy=0x7f1f6c0431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 msgr2=0x7f1f6c004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f1f7c004c60 tx=0x7f1f7c001380).stop 2020-01-26T15:24:29.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 shutdown_connections 2020-01-26T15:24:29.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 --2- 172.21.15.129:0/2970581490 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1f6c003ef0 0x7f1f6c004da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 >> 172.21.15.129:0/2970581490 conn(0x7f1f840a64d0 msgr2=0x7f1f8411e200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 shutdown_connections 2020-01-26T15:24:29.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.642+0000 7f1f8a1d3700 1 -- 172.21.15.129:0/2970581490 wait complete. 2020-01-26T15:24:29.719 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config rm global mon_warn_on_msgr2_not_enabled' 2020-01-26T15:24:29.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 Processor -- start 2020-01-26T15:24:29.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- start start 2020-01-26T15:24:29.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 0x7fbe1c060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:29.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0a7a60 con 0x7fbe1c097720 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c14d6f0 con 0x7fbe1c065e30 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c065bd0 con 0x7fbe1c05f5a0 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe220d3700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 0x7fbe1c060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1b7fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fbe1c097720 0x7fbe1c0a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39718/0 (socket says 172.21.15.129:39718) 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1bfff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbe1c065e30 0x7fbe1c144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48016/0 (socket says 172.21.15.129:48016) 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1b7fe700 1 -- 172.21.15.129:0/188568639 learned_addr learned my addr 172.21.15.129:0/188568639 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe220d3700 1 --2- 172.21.15.129:0/188568639 >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 0x7fbe1c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497476529 0 0) 0x7fbe1c14d6f0 con 0x7fbe1c065e30 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe08003230 con 0x7fbe1c065e30 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668821089 0 0) 0x7fbe1c0a7a60 con 0x7fbe1c097720 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1c14d6f0 con 0x7fbe1c097720 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1432279601 0 0) 0x7fbe08003230 con 0x7fbe1c065e30 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 msgr2=0x7fbe1c060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:29.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 --2- 172.21.15.129:0/188568639 >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 0x7fbe1c060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 >> v1:172.21.15.129:6789/0 conn(0x7fbe1c097720 legacy=0x7fbe1c0a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c145160 con 0x7fbe1c065e30 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbe0c001710 con 0x7fbe1c065e30 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(1 keys) v1 ==== 46+0+0 (unknown 1234196415 0 0) 0x7fbe0c001a80 con 0x7fbe1c065e30 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe1affd700 1 -- 172.21.15.129:0/188568639 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbe0c0046a0 con 0x7fbe1c065e30 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- 172.21.15.129:0/188568639 >> v1:172.21.15.129:6790/0 conn(0x7fbe1c065e30 legacy=0x7fbe1c144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- 172.21.15.129:0/188568639 shutdown_connections 2020-01-26T15:24:29.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 --2- 172.21.15.129:0/188568639 >> v2:172.21.15.129:6790/0 conn(0x7fbe1c05f5a0 0x7fbe1c060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:29.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- 172.21.15.129:0/188568639 >> 172.21.15.129:0/188568639 conn(0x7fbe1c060030 msgr2=0x7fbe1c05e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- 172.21.15.129:0/188568639 shutdown_connections 2020-01-26T15:24:29.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.834+0000 7fbe20e71700 1 -- 172.21.15.129:0/188568639 wait complete. 2020-01-26T15:24:29.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe20e71700 1 Processor -- start 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe20e71700 1 -- start start 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe20e71700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c064ea0 con 0x7fbe1c061f60 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe20e71700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c060ef0 con 0x7fbe1c0774d0 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe20e71700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c07e140 con 0x7fbe1c0a4d50 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe220d3700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbe1c0a4d50 0x7fbe1c12f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45640/0 (socket says 172.21.15.129:45640) 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe1bfff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbe1c0774d0 0x7fbe1c126da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48022/0 (socket says 172.21.15.129:48022) 2020-01-26T15:24:29.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe220d3700 1 -- 172.21.15.129:0/1538163661 learned_addr learned my addr 172.21.15.129:0/1538163661 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948066935 0 0) 0x7fbe1c060ef0 con 0x7fbe1c0774d0 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe00003230 con 0x7fbe1c0774d0 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091753725 0 0) 0x7fbe1c07e140 con 0x7fbe1c0a4d50 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1c060ef0 con 0x7fbe1c0a4d50 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182809019 0 0) 0x7fbe1c064ea0 con 0x7fbe1c061f60 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1c07e140 con 0x7fbe1c061f60 2020-01-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1518005079 0 0) 0x7fbe00003230 con 0x7fbe1c0774d0 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe1c064ea0 con 0x7fbe1c0774d0 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbe0c001c90 con 0x7fbe1c0774d0 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 467740785 0 0) 0x7fbe1c07e140 con 0x7fbe1c061f60 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbe00003230 con 0x7fbe1c061f60 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbe04001b10 con 0x7fbe1c061f60 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6791/0 conn(0x7fbe1c0a4d50 legacy=0x7fbe1c12f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6790/0 conn(0x7fbe1c0774d0 legacy=0x7fbe1c126da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6789/0 conn(0x7fbe1c061f60 legacy=0x7fbe1c0a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbe1c064ea0 con 0x7fbe000040f0 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbe1c060ef0 con 0x7fbe0000ad40 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000053d0 con 0x7fbe00004da0 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.838+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:29.850 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182913806 0 0) 0x7fbe1c060ef0 con 0x7fbe0000ad40 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6791/0 conn(0x7fbe0000ad40 legacy=0x7fbe0000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6790/0 conn(0x7fbe000040f0 legacy=0x7fbe000045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fbe00003e60 con 0x7fbe00004da0 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c0774d0 con 0x7fbe00004da0 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c126da0 con 0x7fbe00004da0 2020-01-26T15:24:29.851 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbe0400ec90 con 0x7fbe00004da0 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(1 keys) v1 ==== 46+0+0 (secure 0 0 0) 0x7fbe04004870 con 0x7fbe00004da0 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf4003360 con 0x7fbe00004da0 2020-01-26T15:24:29.852 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fbe04004af0 con 0x7fbe00004da0 2020-01-26T15:24:29.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.842+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (secure 0 0 0) 0x7fbe0404d6f0 con 0x7fbe00004da0 2020-01-26T15:24:29.853 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.850+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.850+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fbe0404d130 con 0x7fbe00004da0 2020-01-26T15:24:29.976 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.974+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "config rm", "who": "global", "name": "mon_warn_on_msgr2_not_enabled"} v 0) v1 -- 0x7fbdf4002240 con 0x7fbe00004da0 2020-01-26T15:24:29.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.978+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.978+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 6 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040315b0 con 0x7fbe00004da0 2020-01-26T15:24:29.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.978+0000 7fbe1b7fe700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:29.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.978+0000 7fbe18ff9700 1 -- 172.21.15.129:0/1538163661 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "global", "name": "mon_warn_on_msgr2_not_enabled"}]=0 v3) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbe040345f0 con 0x7fbe00004da0 2020-01-26T15:24:29.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.978+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 >> v1:172.21.15.129:6800/16899 conn(0x7fbe000483a0 legacy=0x7fbe0004a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 msgr2=0x7fbe0000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:29.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 --2- 172.21.15.129:0/1538163661 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbe00004da0 0x7fbe0000a7f0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fbe0c001aa0 tx=0x7fbe14005620).stop 2020-01-26T15:24:29.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe220d3700 1 -- 172.21.15.129:0/1538163661 reap_dead start 2020-01-26T15:24:29.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 shutdown_connections 2020-01-26T15:24:29.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 >> 172.21.15.129:0/1538163661 conn(0x7fbe1c025660 msgr2=0x7fbe1c099090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:29.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 shutdown_connections 2020-01-26T15:24:29.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:29.982+0000 7fbe20e71700 1 -- 172.21.15.129:0/1538163661 wait complete. 2020-01-26T15:24:29.999 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release octopus' 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 Processor -- start 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 -- start start 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 0x7f66e0149040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 0x7f66e014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e0094f50 con 0x7f66e0093de0 2020-01-26T15:24:30.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0094a10 con 0x7f66e0146c00 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0094cb0 con 0x7f66e0149590 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ded9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f66e0093de0 0x7f66e0096940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48036/0 (socket says 172.21.15.129:48036) 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ded9d700 1 -- 172.21.15.129:0/3864952939 learned_addr learned my addr 172.21.15.129:0/3864952939 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66de59c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 0x7f66e0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66df59e700 -1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 0x7f66e014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66de59c700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 0x7f66e0149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:30.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66df59e700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 0x7f66e014b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608330147 0 0) 0x7f66e0094f50 con 0x7f66e0093de0 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c8003230 con 0x7f66e0093de0 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2283899535 0 0) 0x7f66c8003230 con 0x7f66e0093de0 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 msgr2=0x7f66e014b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 0x7f66e014b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 msgr2=0x7f66e0149040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:30.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 0x7f66e0149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00985d0 con 0x7f66e0093de0 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f66d0001a90 con 0x7f66e0093de0 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f66d0001e20 con 0x7f66e0093de0 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66ddd9b700 1 -- 172.21.15.129:0/3864952939 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f66d0004930 con 0x7f66e0093de0 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.098+0000 7f66e49e3700 1 -- 172.21.15.129:0/3864952939 >> v1:172.21.15.129:6790/0 conn(0x7f66e0093de0 legacy=0x7f66e0096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- 172.21.15.129:0/3864952939 shutdown_connections 2020-01-26T15:24:30.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6791/0 conn(0x7f66e0149590 0x7f66e014b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:30.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 --2- 172.21.15.129:0/3864952939 >> v2:172.21.15.129:6790/0 conn(0x7f66e0146c00 0x7f66e0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:30.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- 172.21.15.129:0/3864952939 >> 172.21.15.129:0/3864952939 conn(0x7f66e00a6470 msgr2=0x7f66e00a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:30.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- 172.21.15.129:0/3864952939 shutdown_connections 2020-01-26T15:24:30.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- 172.21.15.129:0/3864952939 wait complete. 2020-01-26T15:24:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 Processor -- start 2020-01-26T15:24:30.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- start start 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 0x7f66e012ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 0x7f66e0079b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e007dbb0 con 0x7f66e007a0d0 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f66e0091c00 con 0x7f66e012cf90 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66e49e3700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f66e012d840 con 0x7f66e007d320 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66de59c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 0x7f66e0079b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:30.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66ded9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 0x7f66e012ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66df59e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f66e007a0d0 0x7f66e0130000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48046/0 (socket says 172.21.15.129:48046) 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66df59e700 1 -- 172.21.15.129:0/102146398 learned_addr learned my addr 172.21.15.129:0/102146398 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66de59c700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 0x7f66e0079b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66ded9d700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 0x7f66e012ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976664047 0 0) 0x7f66d8000ee0 con 0x7f66e007a0d0 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.102+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c4003230 con 0x7f66e007a0d0 2020-01-26T15:24:30.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1867085695 0 0) 0x7f66c4003230 con 0x7f66e007a0d0 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66d8000ee0 con 0x7f66e007a0d0 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f66d8001870 con 0x7f66e007a0d0 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1148577167 0 0) 0x7f66d8000ee0 con 0x7f66e007a0d0 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 msgr2=0x7f66e012ca40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 0x7f66e012ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 msgr2=0x7f66e0079b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:30.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 0x7f66e0079b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e011ffe0 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e007ae00 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e012d3c0 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f66d8002270 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f66d8002690 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e0056600 con 0x7f66e007a0d0 2020-01-26T15:24:30.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f66d8002890 con 0x7f66e007a0d0 2020-01-26T15:24:30.116 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.106+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(28..28 src has 1..28) v4 ==== 2897+0+0 (unknown 450505640 0 0) 0x7f66e007dbb0 con 0x7f66e007a0d0 2020-01-26T15:24:30.117 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.114+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f66d8031290 con 0x7f66e007a0d0 2020-01-26T15:24:30.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:30.246+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd require-osd-release", "release": "octopus"} v 0) v1 -- 0x7f66e00800f0 con 0x7f66e007a0d0 2020-01-26T15:24:31.221 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.218+0000 7f66cf7fe700 1 -- 172.21.15.129:0/102146398 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "octopus"}]=0 v30) v1 ==== 93+0+0 (unknown 965680974 0 0) 0x7f66d8001c00 con 0x7f66e007a0d0 2020-01-26T15:24:31.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 >> v1:172.21.15.129:6800/16899 conn(0x7f66c403e0a0 legacy=0x7f66c40405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 >> v1:172.21.15.129:6790/0 conn(0x7f66e007a0d0 legacy=0x7f66e0130000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 shutdown_connections 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6791/0 conn(0x7f66e007d320 0x7f66e012ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 --2- 172.21.15.129:0/102146398 >> v2:172.21.15.129:6790/0 conn(0x7f66e012cf90 0x7f66e0079b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 >> 172.21.15.129:0/102146398 conn(0x7f66e0068690 msgr2=0x7f66e007e110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 shutdown_connections 2020-01-26T15:24:31.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.222+0000 7f66e49e3700 1 -- 172.21.15.129:0/102146398 wait complete. 2020-01-26T15:24:31.235 INFO:teuthology.orchestra.run.smithi129:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2020-01-26T15:24:31.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 Processor -- start 2020-01-26T15:24:31.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 -- start start 2020-01-26T15:24:31.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 0x7f9da4060460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:31.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40a7a60 con 0x7f9da4065e30 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da414d6f0 con 0x7f9da4097720 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f9da4065bd0 con 0x7f9da405f5a0 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9daa25c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f9da4097720 0x7f9da40a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45670/0 (socket says 172.21.15.129:45670) 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9daa25c700 1 -- 172.21.15.129:0/1655240856 learned_addr learned my addr 172.21.15.129:0/1655240856 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9daaa5d700 1 --1- 172.21.15.129:0/1655240856 >> v1:172.21.15.129:6789/0 conn(0x7f9da4065e30 0x7f9da4144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39752/0 (socket says 172.21.15.129:39752) 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dac4c0700 -1 --2- 172.21.15.129:0/1655240856 >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 0x7f9da4060460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:31.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dac4c0700 1 --2- 172.21.15.129:0/1655240856 >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 0x7f9da4060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226008267 0 0) 0x7f9da414d6f0 con 0x7f9da4097720 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d90003230 con 0x7f9da4097720 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050263918 0 0) 0x7f9da40a7a60 con 0x7f9da4065e30 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da414d6f0 con 0x7f9da4065e30 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2812226164 0 0) 0x7f9d90003230 con 0x7f9da4097720 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 msgr2=0x7f9da4060460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 --2- 172.21.15.129:0/1655240856 >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 0x7f9da4060460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:31.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 >> v1:172.21.15.129:6789/0 conn(0x7f9da4065e30 legacy=0x7f9da4144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4145160 con 0x7f9da4097720 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9d94001640 con 0x7f9da4097720 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9d94001910 con 0x7f9da4097720 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9da9a5b700 1 -- 172.21.15.129:0/1655240856 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9d940045b0 con 0x7f9da4097720 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.342+0000 7f9dab25e700 1 -- 172.21.15.129:0/1655240856 >> v1:172.21.15.129:6791/0 conn(0x7f9da4097720 legacy=0x7f9da40a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- 172.21.15.129:0/1655240856 shutdown_connections 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 --2- 172.21.15.129:0/1655240856 >> v2:172.21.15.129:6791/0 conn(0x7f9da405f5a0 0x7f9da4060460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:31.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- 172.21.15.129:0/1655240856 >> 172.21.15.129:0/1655240856 conn(0x7f9da4060030 msgr2=0x7f9da405e960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:31.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- 172.21.15.129:0/1655240856 shutdown_connections 2020-01-26T15:24:31.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- 172.21.15.129:0/1655240856 wait complete. 2020-01-26T15:24:31.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 Processor -- start 2020-01-26T15:24:31.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- start start 2020-01-26T15:24:31.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9da412ff70 0x7f9da4099390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:31.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40256a0 con 0x7f9da40980a0 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da4064e80 con 0x7f9da4025000 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dab25e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f9da41304b0 con 0x7f9da412ff70 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9daa25c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9da40980a0 0x7f9da4121a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39758/0 (socket says 172.21.15.129:39758) 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9daa25c700 1 -- 172.21.15.129:0/427218044 learned_addr learned my addr 172.21.15.129:0/427218044 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dac4c0700 -1 --2- 172.21.15.129:0/427218044 >> v2:172.21.15.129:6790/0 conn(0x7f9da412ff70 0x7f9da4099390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:31.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.346+0000 7f9dac4c0700 1 --2- 172.21.15.129:0/427218044 >> v2:172.21.15.129:6790/0 conn(0x7f9da412ff70 0x7f9da4099390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091386504 0 0) 0x7f9d940044f0 con 0x7f9da40980a0 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d8c003230 con 0x7f9da40980a0 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067411987 0 0) 0x7f9da4064e80 con 0x7f9da4025000 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940044f0 con 0x7f9da4025000 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3687300571 0 0) 0x7f9d8c003230 con 0x7f9da40980a0 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9da4064e80 con 0x7f9da40980a0 2020-01-26T15:24:31.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9d94001ac0 con 0x7f9da40980a0 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 >> v2:172.21.15.129:6790/0 conn(0x7f9da412ff70 msgr2=0x7f9da4099390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 --2- 172.21.15.129:0/427218044 >> v2:172.21.15.129:6790/0 conn(0x7f9da412ff70 0x7f9da4099390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 >> v1:172.21.15.129:6791/0 conn(0x7f9da4025000 legacy=0x7f9da4121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 >> v1:172.21.15.129:6789/0 conn(0x7f9da40980a0 legacy=0x7f9da4121a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9d940044f0 con 0x7f9d8c00a760 2020-01-26T15:24:31.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9d8c003230 con 0x7f9d8c0040b0 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da41304b0 con 0x7f9d8c003c30 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864395668 0 0) 0x7f9d940044f0 con 0x7f9d8c00a760 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d8c00e3b0 con 0x7f9d8c00a760 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081902487 0 0) 0x7f9d8c003230 con 0x7f9d8c0040b0 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 -- 172.21.15.129:0/427218044 >> v1:172.21.15.129:6791/0 conn(0x7f9d8c0040b0 legacy=0x7f9d8c004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 -- 172.21.15.129:0/427218044 >> v1:172.21.15.129:6790/0 conn(0x7f9d8c00a760 legacy=0x7f9d8c00cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da407fff0 con 0x7f9d8c003c30 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da4064b00 con 0x7f9d8c003c30 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da40251a0 con 0x7f9d8c003c30 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9da000eb30 con 0x7f9d8c003c30 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da000ed30 con 0x7f9d8c003c30 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9da0010310 con 0x7f9d8c003c30 2020-01-26T15:24:31.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d80003360 con 0x7f9d8c003c30 2020-01-26T15:24:31.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f9da0010510 con 0x7f9d8c003c30 2020-01-26T15:24:31.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.350+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f9da004d8e0 con 0x7f9d8c003c30 2020-01-26T15:24:31.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.358+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.358+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f9da0033a30 con 0x7f9d8c003c30 2020-01-26T15:24:31.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f9d80003790 con 0x7f9d8c003c30 2020-01-26T15:24:31.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9daaa5d700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9d9b7fe700 1 -- 172.21.15.129:0/427218044 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v30) v1 ==== 59+0+32 (secure 0 0 0) 0x7f9da0033c90 con 0x7f9d8c003c30 2020-01-26T15:24:31.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 >> v1:172.21.15.129:6800/16899 conn(0x7f9d8c048090 legacy=0x7f9d8c04a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 msgr2=0x7f9d8c0045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9dac4c0700 1 -- 172.21.15.129:0/427218044 reap_dead start 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.478+0000 7f9dab25e700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f9da0000f60 tx=0x7f9da0011480).stop 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.482+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 shutdown_connections 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.482+0000 7f9dab25e700 1 --2- 172.21.15.129:0/427218044 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9d8c003c30 0x7f9d8c0045a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.482+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 >> 172.21.15.129:0/427218044 conn(0x7f9da40a61f0 msgr2=0x7f9da407f680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:31.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.482+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 shutdown_connections 2020-01-26T15:24:31.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.482+0000 7f9dab25e700 1 -- 172.21.15.129:0/427218044 wait complete. 2020-01-26T15:24:31.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 Processor -- start 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 -- start start 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f34580a8510 0x7f34580a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580a73c0 con 0x7f34580977f0 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345809a310 con 0x7f345807e6e0 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345e7ac700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f345814e550 con 0x7f34580a8510 2020-01-26T15:24:31.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345dfab700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f34580977f0 0x7f3458060ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39772/0 (socket says 172.21.15.129:39772) 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345dfab700 1 -- 172.21.15.129:0/3708610178 learned_addr learned my addr 172.21.15.129:0/3708610178 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345d7aa700 -1 --2- 172.21.15.129:0/3708610178 >> v2:172.21.15.129:6791/0 conn(0x7f34580a8510 0x7f34580a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345fa0e700 1 --1- 172.21.15.129:0/3708610178 >> v1:172.21.15.129:6790/0 conn(0x7f345807e6e0 0x7f345807eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48074/0 (socket says 172.21.15.129:48074) 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345d7aa700 1 --2- 172.21.15.129:0/3708610178 >> v2:172.21.15.129:6791/0 conn(0x7f34580a8510 0x7f34580a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521250705 0 0) 0x7f34580a73c0 con 0x7f34580977f0 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3444003230 con 0x7f34580977f0 2020-01-26T15:24:31.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716492678 0 0) 0x7f345809a310 con 0x7f345807e6e0 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34580a73c0 con 0x7f345807e6e0 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2720228138 0 0) 0x7f3444003230 con 0x7f34580977f0 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 >> v2:172.21.15.129:6791/0 conn(0x7f34580a8510 msgr2=0x7f34580a6e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 --2- 172.21.15.129:0/3708610178 >> v2:172.21.15.129:6791/0 conn(0x7f34580a8510 0x7f34580a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 >> v1:172.21.15.129:6790/0 conn(0x7f345807e6e0 legacy=0x7f345807eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345814e710 con 0x7f34580977f0 2020-01-26T15:24:31.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3454001710 con 0x7f34580977f0 2020-01-26T15:24:31.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 >> v1:172.21.15.129:6789/0 conn(0x7f34580977f0 legacy=0x7f3458060ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:31.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3444003230 con 0x7f3444003540 2020-01-26T15:24:31.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f34580a73c0 con 0x7f344400a7f0 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345814e550 con 0x7f3444004af0 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339547436 0 0) 0x7f3444003230 con 0x7f3444003540 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.594+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345809a310 con 0x7f3444003540 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 -- 172.21.15.129:0/3708610178 >> v1:172.21.15.129:6791/0 conn(0x7f344400a7f0 legacy=0x7f344400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 -- 172.21.15.129:0/3708610178 >> v1:172.21.15.129:6790/0 conn(0x7f3444003540 legacy=0x7f3444003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 -- 172.21.15.129:0/3708610178 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444054530 con 0x7f3444004af0 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3454001520 tx=0x7f345400c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3454001520 tx=0x7f345400c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f3454001520 tx=0x7f345400c1f0).ready entity=mon.0 client_cookie=f6861e19642f8ee1 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f3454001520 tx=0x7f345400c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3454010160 con 0x7f3444004af0 2020-01-26T15:24:31.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f3454001520 tx=0x7f345400c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f3454001520 tx=0x7f345400c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:31.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454010360 con 0x7f3444004af0 2020-01-26T15:24:31.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345cfa9700 1 -- 172.21.15.129:0/3708610178 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3454010700 con 0x7f3444004af0 2020-01-26T15:24:31.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 msgr2=0x7f3444004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 --2- 172.21.15.129:0/3708610178 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3444004af0 0x7f3444004f20 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f3454001520 tx=0x7f345400c1f0).stop 2020-01-26T15:24:31.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345fa0e700 1 -- 172.21.15.129:0/3708610178 reap_dead start 2020-01-26T15:24:31.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- 172.21.15.129:0/3708610178 shutdown_connections 2020-01-26T15:24:31.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- 172.21.15.129:0/3708610178 >> 172.21.15.129:0/3708610178 conn(0x7f3458066370 msgr2=0x7f3458060030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:31.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- 172.21.15.129:0/3708610178 shutdown_connections 2020-01-26T15:24:31.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- 172.21.15.129:0/3708610178 wait complete. 2020-01-26T15:24:31.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 Processor -- start 2020-01-26T15:24:31.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- start start 2020-01-26T15:24:31.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 0x7f3458098740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:31.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580a00b0 con 0x7f3458098c90 2020-01-26T15:24:31.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3458099180 con 0x7f3458136280 2020-01-26T15:24:31.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345e7ac700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f345807c970 con 0x7f3458130e40 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 0x7f3458098740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345d7aa700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f3458098c90 0x7f345812ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48088/0 (socket says 172.21.15.129:48088) 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345fa0e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f3458136280 0x7f34581386c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45702/0 (socket says 172.21.15.129:45702) 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345d7aa700 1 -- 172.21.15.129:0/2094032206 learned_addr learned my addr 172.21.15.129:0/2094032206 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f345dfab700 1 --2- 172.21.15.129:0/2094032206 >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 0x7f3458098740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:31.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940782531 0 0) 0x7f34580a00b0 con 0x7f3458098c90 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440003230 con 0x7f3458098c90 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835151382 0 0) 0x7f3458099180 con 0x7f3458136280 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34580a00b0 con 0x7f3458136280 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2228142999 0 0) 0x7f3440003230 con 0x7f3458098c90 2020-01-26T15:24:31.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3458099180 con 0x7f3458098c90 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3448002750 con 0x7f3458098c90 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 195299597 0 0) 0x7f34580a00b0 con 0x7f3458136280 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.598+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3440003230 con 0x7f3458136280 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3450001ca0 con 0x7f3458136280 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 538436676 0 0) 0x7f3458099180 con 0x7f3458098c90 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 msgr2=0x7f3458098740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 --2- 172.21.15.129:0/2094032206 >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 0x7f3458098740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 >> v1:172.21.15.129:6791/0 conn(0x7f3458136280 legacy=0x7f34581386c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458098310 con 0x7f3458098c90 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345807c540 con 0x7f3458098c90 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f345812b340 con 0x7f3458098c90 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3448001020 con 0x7f3458098c90 2020-01-26T15:24:31.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3448001440 con 0x7f3458098c90 2020-01-26T15:24:31.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3434003360 con 0x7f3458098c90 2020-01-26T15:24:31.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f3448001640 con 0x7f3458098c90 2020-01-26T15:24:31.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.602+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(30..30 src has 1..30) v4 ==== 3301+0+0 (unknown 1309675428 0 0) 0x7f344804ba30 con 0x7f3458098c90 2020-01-26T15:24:31.618 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.606+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3448030ff0 con 0x7f3458098c90 2020-01-26T15:24:31.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:31.726+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f3434002240 con 0x7f3458098c90 2020-01-26T15:24:32.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f344e7fc700 1 -- 172.21.15.129:0/2094032206 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v31) v1 ==== 152+0+0 (unknown 2124105973 0 0) 0x7f344804a6e0 con 0x7f3458098c90 2020-01-26T15:24:32.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 >> v1:172.21.15.129:6800/16899 conn(0x7f344003e470 legacy=0x7f3440040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 >> v1:172.21.15.129:6790/0 conn(0x7f3458098c90 legacy=0x7f345812ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 shutdown_connections 2020-01-26T15:24:32.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 --2- 172.21.15.129:0/2094032206 >> v2:172.21.15.129:6790/0 conn(0x7f3458130e40 0x7f3458098740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:32.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 >> 172.21.15.129:0/2094032206 conn(0x7f3458060250 msgr2=0x7f345805ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:32.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 shutdown_connections 2020-01-26T15:24:32.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.230+0000 7f345e7ac700 1 -- 172.21.15.129:0/2094032206 wait complete. 2020-01-26T15:24:32.234 INFO:teuthology.orchestra.run.smithi129.stderr:set pool 1 pg_autoscale_mode to off 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.342+0000 7f696e6d9700 1 Processor -- start 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.342+0000 7f696e6d9700 1 -- start start 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f696807eee0 0x7f69680a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69680a73c0 con 0x7f69680a8510 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696809a310 con 0x7f69680977f0 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f696814e550 con 0x7f696807eee0 2020-01-26T15:24:32.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696d6d7700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f69680a8510 0x7f696807e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39792/0 (socket says 172.21.15.129:39792) 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696d6d7700 1 -- 172.21.15.129:0/1663892246 learned_addr learned my addr 172.21.15.129:0/1663892246 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696f93b700 -1 --2- 172.21.15.129:0/1663892246 >> v2:172.21.15.129:6791/0 conn(0x7f696807eee0 0x7f69680a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696f93b700 1 --2- 172.21.15.129:0/1663892246 >> v2:172.21.15.129:6791/0 conn(0x7f696807eee0 0x7f69680a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045601853 0 0) 0x7f69680a73c0 con 0x7f69680a8510 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6954003230 con 0x7f69680a8510 2020-01-26T15:24:32.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411704646 0 0) 0x7f696809a310 con 0x7f69680977f0 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69680a73c0 con 0x7f69680977f0 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1903527866 0 0) 0x7f6954003230 con 0x7f69680a8510 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 >> v2:172.21.15.129:6791/0 conn(0x7f696807eee0 msgr2=0x7f69680a6e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 --2- 172.21.15.129:0/1663892246 >> v2:172.21.15.129:6791/0 conn(0x7f696807eee0 0x7f69680a6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 >> v1:172.21.15.129:6791/0 conn(0x7f69680977f0 legacy=0x7f6968060ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696814e710 con 0x7f69680a8510 2020-01-26T15:24:32.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6958001710 con 0x7f69680a8510 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 >> v1:172.21.15.129:6789/0 conn(0x7f69680a8510 legacy=0x7f696807e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6954003230 con 0x7f69540045a0 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f69680a73c0 con 0x7f695400a7f0 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696814e550 con 0x7f6954003ac0 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:32.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030204782 0 0) 0x7f69680a73c0 con 0x7f695400a7f0 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f696809a310 con 0x7f695400a7f0 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465338910 0 0) 0x7f6954003230 con 0x7f69540045a0 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 -- 172.21.15.129:0/1663892246 >> v1:172.21.15.129:6791/0 conn(0x7f695400a7f0 legacy=0x7f695400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 -- 172.21.15.129:0/1663892246 >> v1:172.21.15.129:6790/0 conn(0x7f69540045a0 legacy=0x7f69540049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 -- 172.21.15.129:0/1663892246 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695400f450 con 0x7f6954003ac0 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6964000fe0 tx=0x7f696400c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:32.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6964000fe0 tx=0x7f696400c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f6964000fe0 tx=0x7f696400c240).ready entity=mon.0 client_cookie=ad22524f1c0cf69e server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6964000fe0 tx=0x7f696400c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f696400c7b0 con 0x7f6954003ac0 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6964000fe0 tx=0x7f696400c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ded8700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6964000fe0 tx=0x7f696400c240).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696400c9b0 con 0x7f6954003ac0 2020-01-26T15:24:32.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696ced6700 1 -- 172.21.15.129:0/1663892246 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f696400cdd0 con 0x7f6954003ac0 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 msgr2=0x7f6954003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 --2- 172.21.15.129:0/1663892246 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6954003ac0 0x7f6954003ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f6964000fe0 tx=0x7f696400c240).stop 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696f93b700 1 -- 172.21.15.129:0/1663892246 reap_dead start 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- 172.21.15.129:0/1663892246 shutdown_connections 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- 172.21.15.129:0/1663892246 >> 172.21.15.129:0/1663892246 conn(0x7f6968066370 msgr2=0x7f6968060030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- 172.21.15.129:0/1663892246 shutdown_connections 2020-01-26T15:24:32.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.346+0000 7f696e6d9700 1 -- 172.21.15.129:0/1663892246 wait complete. 2020-01-26T15:24:32.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 Processor -- start 2020-01-26T15:24:32.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 -- start start 2020-01-26T15:24:32.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 0x7f696812cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:32.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 0x7f696813a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968080060 con 0x7f696807db00 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f696807cd30 con 0x7f696812c690 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696e6d9700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f696807cfd0 con 0x7f696812d010 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696ded8700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f696807db00 0x7f69680a13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45720/0 (socket says 172.21.15.129:45720) 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696ded8700 1 -- 172.21.15.129:0/1843874291 learned_addr learned my addr 172.21.15.129:0/1843874291 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:32.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696d6d7700 -1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 0x7f696812cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.350+0000 7f696f93b700 -1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 0x7f696813a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f696f93b700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 0x7f696813a650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f696d6d7700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 0x7f696812cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163008582 0 0) 0x7f6968080060 con 0x7f696807db00 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6950003230 con 0x7f696807db00 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 990614772 0 0) 0x7f6950003230 con 0x7f696807db00 2020-01-26T15:24:32.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6968080060 con 0x7f696807db00 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f696400bad0 con 0x7f696807db00 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3680401641 0 0) 0x7f6968080060 con 0x7f696807db00 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 msgr2=0x7f696813a650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 0x7f696813a650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 msgr2=0x7f696812cac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 0x7f696812cac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:32.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696812d440 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696807df30 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f696807c130 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f696400c600 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f696400ca60 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f696400cc60 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(31..31 src has 1..31) v4 ==== 3301+0+0 (unknown 2549259608 0 0) 0x7f696404cef0 con 0x7f696807db00 2020-01-26T15:24:32.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.354+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6944003360 con 0x7f696807db00 2020-01-26T15:24:32.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.362+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f69640322d0 con 0x7f696807db00 2020-01-26T15:24:32.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:32.482+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f6944002240 con 0x7f696807db00 2020-01-26T15:24:33.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.238+0000 7f695e7fc700 1 -- 172.21.15.129:0/1843874291 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v32) v1 ==== 164+0+0 (unknown 3692496525 0 0) 0x7f6964032530 con 0x7f696807db00 2020-01-26T15:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 >> v1:172.21.15.129:6800/16899 conn(0x7f695003e1c0 legacy=0x7f69500406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:33.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 >> v1:172.21.15.129:6791/0 conn(0x7f696807db00 legacy=0x7f69680a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 shutdown_connections 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6791/0 conn(0x7f696812d010 0x7f696813a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 --2- 172.21.15.129:0/1843874291 >> v2:172.21.15.129:6790/0 conn(0x7f696812c690 0x7f696812cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 >> 172.21.15.129:0/1843874291 conn(0x7f6968068630 msgr2=0x7f69680a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 shutdown_connections 2020-01-26T15:24:33.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.242+0000 7f696e6d9700 1 -- 172.21.15.129:0/1843874291 wait complete. 2020-01-26T15:24:33.247 INFO:teuthology.orchestra.run.smithi129.stderr:set pool 2 pg_autoscale_mode to off 2020-01-26T15:24:33.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.354+0000 7fd92c818700 1 Processor -- start 2020-01-26T15:24:33.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.354+0000 7fd92c818700 1 -- start start 2020-01-26T15:24:33.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928098220 con 0x7fd928092e20 2020-01-26T15:24:33.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92805b340 con 0x7fd928093d90 2020-01-26T15:24:33.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928096190 con 0x7fd928095d60 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd926d9d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fd928092e20 0x7fd928096940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39814/0 (socket says 172.21.15.129:39814) 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd926d9d700 1 -- 172.21.15.129:0/1599996545 learned_addr learned my addr 172.21.15.129:0/1599996545 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92659c700 1 --1- 172.21.15.129:0/1599996545 >> v1:172.21.15.129:6790/0 conn(0x7fd928093d90 0x7fd928097140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48114/0 (socket says 172.21.15.129:48114) 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729462210 0 0) 0x7fd928096190 con 0x7fd928095d60 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd910003230 con 0x7fd928095d60 2020-01-26T15:24:33.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841043359 0 0) 0x7fd92805b340 con 0x7fd928093d90 2020-01-26T15:24:33.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928096190 con 0x7fd928093d90 2020-01-26T15:24:33.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422227711 0 0) 0x7fd928098220 con 0x7fd928092e20 2020-01-26T15:24:33.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92805b340 con 0x7fd928092e20 2020-01-26T15:24:33.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1207608887 0 0) 0x7fd910003230 con 0x7fd928095d60 2020-01-26T15:24:33.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 >> v1:172.21.15.129:6790/0 conn(0x7fd928093d90 legacy=0x7fd928097140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:33.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 >> v1:172.21.15.129:6789/0 conn(0x7fd928092e20 legacy=0x7fd928096940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:33.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928080610 con 0x7fd928095d60 2020-01-26T15:24:33.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd9200019c0 con 0x7fd928095d60 2020-01-26T15:24:33.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd920001c90 con 0x7fd928095d60 2020-01-26T15:24:33.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd925d9b700 1 -- 172.21.15.129:0/1599996545 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd920002240 con 0x7fd928095d60 2020-01-26T15:24:33.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- 172.21.15.129:0/1599996545 >> v1:172.21.15.129:6791/0 conn(0x7fd928095d60 legacy=0x7fd92814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:33.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- 172.21.15.129:0/1599996545 shutdown_connections 2020-01-26T15:24:33.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- 172.21.15.129:0/1599996545 >> 172.21.15.129:0/1599996545 conn(0x7fd92805ec00 msgr2=0x7fd92805f030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:33.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- 172.21.15.129:0/1599996545 shutdown_connections 2020-01-26T15:24:33.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- 172.21.15.129:0/1599996545 wait complete. 2020-01-26T15:24:33.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 Processor -- start 2020-01-26T15:24:33.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.358+0000 7fd92c818700 1 -- start start 2020-01-26T15:24:33.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 0x7fd928079f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 0x7fd928122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280793e0 con 0x7fd928078b80 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd928123730 con 0x7fd9280781d0 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd928091f20 con 0x7fd928078fb0 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd926d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 0x7fd928079f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92659c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fd928078b80 0x7fd9281226b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48120/0 (socket says 172.21.15.129:48120) 2020-01-26T15:24:33.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd926d9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 0x7fd928079f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92659c700 1 -- 172.21.15.129:0/2924943698 learned_addr learned my addr 172.21.15.129:0/2924943698 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92759e700 -1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 0x7fd928122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92759e700 1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 0x7fd928122eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138330621 0 0) 0x7fd9280793e0 con 0x7fd928078b80 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c003230 con 0x7fd928078b80 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 782540600 0 0) 0x7fd90c003230 con 0x7fd928078b80 2020-01-26T15:24:33.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9280793e0 con 0x7fd928078b80 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd91c001910 con 0x7fd928078b80 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4293240054 0 0) 0x7fd9280793e0 con 0x7fd928078b80 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 msgr2=0x7fd928122eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 0x7fd928122eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 msgr2=0x7fd928079f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 0x7fd928079f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928123400 con 0x7fd928078b80 2020-01-26T15:24:33.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92807a610 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92813b2c0 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd91c0048a0 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd91c004c40 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fd91c010680 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(32..32 src has 1..32) v4 ==== 3301+0+0 (unknown 2720990462 0 0) 0x7fd91c04bb50 con 0x7fd928078b80 2020-01-26T15:24:33.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.362+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd928056600 con 0x7fd928078b80 2020-01-26T15:24:33.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.370+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fd91c031150 con 0x7fd928078b80 2020-01-26T15:24:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:33.490+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd92805e220 con 0x7fd928078b80 2020-01-26T15:24:34.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.254+0000 7fd9177fe700 1 -- 172.21.15.129:0/2924943698 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v33) v1 ==== 160+0+0 (unknown 3865343736 0 0) 0x7fd91c04a840 con 0x7fd928078b80 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 >> v1:172.21.15.129:6800/16899 conn(0x7fd90c03e050 legacy=0x7fd90c040560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 >> v1:172.21.15.129:6790/0 conn(0x7fd928078b80 legacy=0x7fd9281226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 shutdown_connections 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6791/0 conn(0x7fd928078fb0 0x7fd928122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 --2- 172.21.15.129:0/2924943698 >> v2:172.21.15.129:6790/0 conn(0x7fd9280781d0 0x7fd928079f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:34.261 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 >> 172.21.15.129:0/2924943698 conn(0x7fd928096870 msgr2=0x7fd92807f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:34.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 shutdown_connections 2020-01-26T15:24:34.262 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.258+0000 7fd92c818700 1 -- 172.21.15.129:0/2924943698 wait complete. 2020-01-26T15:24:34.262 INFO:teuthology.orchestra.run.smithi129.stderr:set pool 3 pg_autoscale_mode to off 2020-01-26T15:24:34.275 INFO:teuthology.run_tasks:Running task ceph.healthy... 2020-01-26T15:24:34.330 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-01-26T15:24:34.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-01-26T15:24:34.330 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 Processor -- start 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 -- start start 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 0x7f98a00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a00a6dc0 con 0x7f98a005edd0 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a005ea20 con 0x7f98a0149040 2020-01-26T15:24:34.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f98a0098000 con 0x7f98a005e5f0 2020-01-26T15:24:34.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a6a85700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f98a0149040 0x7f98a014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45748/0 (socket says 172.21.15.129:45748) 2020-01-26T15:24:34.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5022700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f98a005edd0 0x7f98a007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39828/0 (socket says 172.21.15.129:39828) 2020-01-26T15:24:34.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a6a85700 1 -- 172.21.15.129:0/1383858269 learned_addr learned my addr 172.21.15.129:0/1383858269 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:34.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a4821700 -1 --2- 172.21.15.129:0/1383858269 >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 0x7f98a00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:34.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a4821700 1 --2- 172.21.15.129:0/1383858269 >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 0x7f98a00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061832709 0 0) 0x7f98a005ea20 con 0x7f98a0149040 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f988c003230 con 0x7f98a0149040 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654896354 0 0) 0x7f98a00a6dc0 con 0x7f98a005edd0 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a005ea20 con 0x7f98a005edd0 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1976653766 0 0) 0x7f988c003230 con 0x7f98a0149040 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 msgr2=0x7f98a00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:34.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 --2- 172.21.15.129:0/1383858269 >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 0x7f98a00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 >> v1:172.21.15.129:6789/0 conn(0x7f98a005edd0 legacy=0x7f98a007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a005e050 con 0x7f98a0149040 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9898001a90 con 0x7f98a0149040 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9898001ce0 con 0x7f98a0149040 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f989ffff700 1 -- 172.21.15.129:0/1383858269 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9898004930 con 0x7f98a0149040 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.446+0000 7f98a5823700 1 -- 172.21.15.129:0/1383858269 >> v1:172.21.15.129:6791/0 conn(0x7f98a0149040 legacy=0x7f98a014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 -- 172.21.15.129:0/1383858269 shutdown_connections 2020-01-26T15:24:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 --2- 172.21.15.129:0/1383858269 >> v2:172.21.15.129:6790/0 conn(0x7f98a005e5f0 0x7f98a00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 -- 172.21.15.129:0/1383858269 >> 172.21.15.129:0/1383858269 conn(0x7f98a0098e70 msgr2=0x7f98a00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 -- 172.21.15.129:0/1383858269 shutdown_connections 2020-01-26T15:24:34.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 -- 172.21.15.129:0/1383858269 wait complete. 2020-01-26T15:24:34.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 Processor -- start 2020-01-26T15:24:34.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.450+0000 7f98a5823700 1 -- start start 2020-01-26T15:24:34.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f98a01234a0 0x7f98a0131110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:34.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a0099a00 con 0x7f98a0123070 2020-01-26T15:24:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a0131e60 con 0x7f98a009e5b0 2020-01-26T15:24:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f98a00a0f50 con 0x7f98a01234a0 2020-01-26T15:24:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5022700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f98a0123070 0x7f98a009ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39834/0 (socket says 172.21.15.129:39834) 2020-01-26T15:24:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5022700 1 -- 172.21.15.129:0/3191966471 learned_addr learned my addr 172.21.15.129:0/3191966471 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:34.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 -1 --2- 172.21.15.129:0/3191966471 >> v2:172.21.15.129:6791/0 conn(0x7f98a01234a0 0x7f98a0131110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> v2:172.21.15.129:6791/0 conn(0x7f98a01234a0 0x7f98a0131110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653462641 0 0) 0x7f98a0099a00 con 0x7f98a0123070 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9884003230 con 0x7f98a0123070 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897735511 0 0) 0x7f98a0131e60 con 0x7f98a009e5b0 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a0099a00 con 0x7f98a009e5b0 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 802757199 0 0) 0x7f9884003230 con 0x7f98a0123070 2020-01-26T15:24:34.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98a0131e60 con 0x7f98a0123070 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9890001850 con 0x7f98a0123070 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 >> v2:172.21.15.129:6791/0 conn(0x7f98a01234a0 msgr2=0x7f98a0131110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 --2- 172.21.15.129:0/3191966471 >> v2:172.21.15.129:6791/0 conn(0x7f98a01234a0 0x7f98a0131110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 >> v1:172.21.15.129:6791/0 conn(0x7f98a009e5b0 legacy=0x7f98a0131660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 >> v1:172.21.15.129:6789/0 conn(0x7f98a0123070 legacy=0x7f98a009ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9884003230 con 0x7f9884003c30 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f988400f450 con 0x7f988400a7f0 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00a0f50 con 0x7f98840040c0 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873631720 0 0) 0x7f9884003230 con 0x7f9884003c30 2020-01-26T15:24:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f988400e440 con 0x7f9884003c30 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810347182 0 0) 0x7f988400f450 con 0x7f988400a7f0 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 -- 172.21.15.129:0/3191966471 >> v1:172.21.15.129:6791/0 conn(0x7f988400a7f0 legacy=0x7f988400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 -- 172.21.15.129:0/3191966471 >> v1:172.21.15.129:6790/0 conn(0x7f9884003c30 legacy=0x7f98840045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00a1a40 con 0x7f98840040c0 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a00a4690 con 0x7f98840040c0 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a009e7d0 con 0x7f98840040c0 2020-01-26T15:24:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.454+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9888005c10 con 0x7f98840040c0 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9888005e10 con 0x7f98840040c0 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9888008a90 con 0x7f98840040c0 2020-01-26T15:24:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f988800a180 con 0x7f98840040c0 2020-01-26T15:24:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878003360 con 0x7f98840040c0 2020-01-26T15:24:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.458+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f988804cf00 con 0x7f98840040c0 2020-01-26T15:24:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.466+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.466+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f9888008d60 con 0x7f98840040c0 2020-01-26T15:24:34.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.610+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f98780021f0 con 0x7f98840040c0 2020-01-26T15:24:34.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a4821700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f989dffb700 1 -- 172.21.15.129:0/3191966471 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+97429 (secure 0 0 0) 0x7f98880307b0 con 0x7f98840040c0 2020-01-26T15:24:34.621 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:34.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 >> v1:172.21.15.129:6800/16899 conn(0x7f9884048480 legacy=0x7f988404a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 msgr2=0x7f9884004dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 --2- 172.21.15.129:0/3191966471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f98840040c0 0x7f9884004dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f9888002f30 tx=0x7f9888010a90).stop 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a6a85700 1 -- 172.21.15.129:0/3191966471 reap_dead start 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a6a85700 1 -- 172.21.15.129:0/3191966471 reap_dead start 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 shutdown_connections 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 >> 172.21.15.129:0/3191966471 conn(0x7f98a0024860 msgr2=0x7f98a0024f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:34.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 shutdown_connections 2020-01-26T15:24:34.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.618+0000 7f98a5823700 1 -- 172.21.15.129:0/3191966471 wait complete. 2020-01-26T15:24:34.638 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":7,"active_gid":44103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6800","nonce":16899}]},"active_addr":"172.21.15.129:6800/16899","active_change":"2020-01-26T15:24:08.609463+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":44100,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["balancer","crash","iostat","restful","status"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":17,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":1091869231}]},{"addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":2795254467}]},{"addrvec":[{"type":"v2","addr":"172.21.15.129:0","nonce":2602703501}]}]}} 2020-01-26T15:24:34.650 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-01-26T15:24:34.650 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-01-26T15:24:34.651 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 Processor -- start 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 -- start start 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fac2c05edd0 0x7fac2c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c098000 con 0x7fac2c149040 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c05e050 con 0x7fac2c0a6870 2020-01-26T15:24:34.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2bfff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c0a6ca0 con 0x7fac2c05edd0 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2b7fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fac2c05edd0 0x7fac2c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac314c9700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fac2c149040 0x7fac2c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39850/0 (socket says 172.21.15.129:39850) 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2affd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fac2c0a6870 0x7fac2c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48152/0 (socket says 172.21.15.129:48152) 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac2b7fe700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fac2c05edd0 0x7fac2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.758+0000 7fac314c9700 1 -- 172.21.15.129:0/1832066200 learned_addr learned my addr 172.21.15.129:0/1832066200 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500730238 0 0) 0x7fac2c098000 con 0x7fac2c149040 2020-01-26T15:24:34.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac14003230 con 0x7fac2c149040 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224501632 0 0) 0x7fac2c05e050 con 0x7fac2c0a6870 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c098000 con 0x7fac2c0a6870 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1295599002 0 0) 0x7fac14003230 con 0x7fac2c149040 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 >> v2:172.21.15.129:6790/0 conn(0x7fac2c05edd0 msgr2=0x7fac2c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 --2- 172.21.15.129:0/1832066200 >> v2:172.21.15.129:6790/0 conn(0x7fac2c05edd0 0x7fac2c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 >> v1:172.21.15.129:6790/0 conn(0x7fac2c0a6870 legacy=0x7fac2c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c14ecb0 con 0x7fac2c149040 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fac24001710 con 0x7fac2c149040 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 >> v1:172.21.15.129:6789/0 conn(0x7fac2c149040 legacy=0x7fac2c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fac14003230 con 0x7fac1400a7f0 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fac2c05e050 con 0x7fac140045a0 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0a6ca0 con 0x7fac14003ac0 2020-01-26T15:24:34.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110106404 0 0) 0x7fac2c05e050 con 0x7fac140045a0 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1400e440 con 0x7fac140045a0 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298328871 0 0) 0x7fac14003230 con 0x7fac1400a7f0 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c05e050 con 0x7fac1400a7f0 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 -- 172.21.15.129:0/1832066200 >> v1:172.21.15.129:6791/0 conn(0x7fac140045a0 legacy=0x7fac14004a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 -- 172.21.15.129:0/1832066200 >> v1:172.21.15.129:6790/0 conn(0x7fac1400a7f0 legacy=0x7fac1400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 -- 172.21.15.129:0/1832066200 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140545f0 con 0x7fac14003ac0 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).ready entity=mon.0 client_cookie=17b192c0376d471a server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fac1c010af0 con 0x7fac14003ac0 2020-01-26T15:24:34.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c010cf0 con 0x7fac14003ac0 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2a7fc700 1 -- 172.21.15.129:0/1832066200 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fac1c011270 con 0x7fac14003ac0 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 -- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 msgr2=0x7fac14003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 --2- 172.21.15.129:0/1832066200 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac14003ac0 0x7fac14003f10 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fac1c008c80 tx=0x7fac1c0101e0).stop 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac314c9700 1 -- 172.21.15.129:0/1832066200 reap_dead start 2020-01-26T15:24:34.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 -- 172.21.15.129:0/1832066200 shutdown_connections 2020-01-26T15:24:34.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 -- 172.21.15.129:0/1832066200 >> 172.21.15.129:0/1832066200 conn(0x7fac2c098e70 msgr2=0x7fac2c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:34.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 -- 172.21.15.129:0/1832066200 shutdown_connections 2020-01-26T15:24:34.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.762+0000 7fac2bfff700 1 -- 172.21.15.129:0/1832066200 wait complete. 2020-01-26T15:24:34.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 Processor -- start 2020-01-26T15:24:34.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 -- start start 2020-01-26T15:24:34.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fac2c09ac10 0x7fac2c0a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:34.778 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c09a1b0 con 0x7fac2c099a30 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c099e60 con 0x7fac2c11f640 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c123260 con 0x7fac2c09ac10 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2b7fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fac2c09ac10 0x7fac2c0a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fac2c11f640 0x7fac2c09e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48162/0 (socket says 172.21.15.129:48162) 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 -- 172.21.15.129:0/3865466814 learned_addr learned my addr 172.21.15.129:0/3865466814 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2b7fe700 1 --2- 172.21.15.129:0/3865466814 >> v2:172.21.15.129:6790/0 conn(0x7fac2c09ac10 0x7fac2c0a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:34.779 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306800962 0 0) 0x7fac2c09a1b0 con 0x7fac2c099a30 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c003230 con 0x7fac2c099a30 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711968014 0 0) 0x7fac2c099e60 con 0x7fac2c11f640 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2c09a1b0 con 0x7fac2c11f640 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3654876732 0 0) 0x7fac0c003230 con 0x7fac2c099a30 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac2c099e60 con 0x7fac2c099a30 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fac24001c70 con 0x7fac2c099a30 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 >> v2:172.21.15.129:6790/0 conn(0x7fac2c09ac10 msgr2=0x7fac2c0a1060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:34.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 --2- 172.21.15.129:0/3865466814 >> v2:172.21.15.129:6790/0 conn(0x7fac2c09ac10 0x7fac2c0a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 >> v1:172.21.15.129:6790/0 conn(0x7fac2c11f640 legacy=0x7fac2c09e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 >> v1:172.21.15.129:6789/0 conn(0x7fac2c099a30 legacy=0x7fac2c07c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fac2c09a1b0 con 0x7fac0c00a7f0 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fac0c003230 con 0x7fac0c003bc0 2020-01-26T15:24:34.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c123260 con 0x7fac0c003ff0 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914964337 0 0) 0x7fac0c003230 con 0x7fac0c003bc0 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c00e440 con 0x7fac0c003bc0 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703200559 0 0) 0x7fac2c09a1b0 con 0x7fac0c00a7f0 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 -- 172.21.15.129:0/3865466814 >> v1:172.21.15.129:6791/0 conn(0x7fac0c003bc0 legacy=0x7fac0c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 -- 172.21.15.129:0/3865466814 >> v1:172.21.15.129:6790/0 conn(0x7fac0c00a7f0 legacy=0x7fac0c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c09e8c0 con 0x7fac0c003ff0 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c11f640 con 0x7fac0c003ff0 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.766+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c09e0c0 con 0x7fac0c003ff0 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fac2000b400 con 0x7fac0c003ff0 2020-01-26T15:24:34.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20008610 con 0x7fac0c003ff0 2020-01-26T15:24:34.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fac20008a70 con 0x7fac0c003ff0 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fac20008c70 con 0x7fac0c003ff0 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04003360 con 0x7fac0c003ff0 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.770+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7fac2004dce0 con 0x7fac0c003ff0 2020-01-26T15:24:34.785 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.774+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.774+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fac20033e30 con 0x7fac0c003ff0 2020-01-26T15:24:34.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.894+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac040021f0 con 0x7fac0c003ff0 2020-01-26T15:24:34.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.894+0000 7fac2affd700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:34.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.894+0000 7fac13fff700 1 -- 172.21.15.129:0/3865466814 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+9080 (secure 0 0 0) 0x7fac20034090 con 0x7fac0c003ff0 2020-01-26T15:24:34.899 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:34.899 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":33,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:34.237474+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":17867}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":17867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":17867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":17867}]},"public_addr":"172.21.15.129:6805/17867","cluster_addr":"172.21.15.129:6806/17867","heartbeat_back_addr":"172.21.15.129:6808/17867","heartbeat_front_addr":"172.21.15.129:6807/17867","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":25,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":18164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":18164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":18164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":18164}]},"public_addr":"172.21.15.129:6813/18164","cluster_addr":"172.21.15.129:6814/18164","heartbeat_back_addr":"172.21.15.129:6816/18164","heartbeat_front_addr":"172.21.15.129:6815/18164","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":24,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":17994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":17994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":17994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":17994}]},"public_addr":"172.21.15.129:6809/17994","cluster_addr":"172.21.15.129:6810/17994","heartbeat_back_addr":"172.21.15.129:6812/17994","heartbeat_front_addr":"172.21.15.129:6811/17994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.129:6819/2338999715":"2020-01-27T15:24:28.612769+0000","172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:34.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 >> v1:172.21.15.129:6800/16899 conn(0x7fac0c048140 legacy=0x7fac0c04a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac314c9700 1 -- 172.21.15.129:0/3865466814 reap_dead start 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 msgr2=0x7fac0c004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7fac20001810 tx=0x7fac20011620).stop 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 shutdown_connections 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 --2- 172.21.15.129:0/3865466814 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fac0c003ff0 0x7fac0c004da0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 >> 172.21.15.129:0/3865466814 conn(0x7fac2c098e10 msgr2=0x7fac2c07f260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 shutdown_connections 2020-01-26T15:24:34.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:34.898+0000 7fac2bfff700 1 -- 172.21.15.129:0/3865466814 wait complete. 2020-01-26T15:24:34.912 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-01-26T15:24:34.913 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-01-26T15:24:35.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 Processor -- start 2020-01-26T15:24:35.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 -- start start 2020-01-26T15:24:35.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f497c0a5750 0x7f497c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f497c0a4b50 0x7f497c05ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c0a5b80 con 0x7f497c05efa0 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0a43f0 con 0x7f497c0a4b50 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0a4f80 con 0x7f497c0a5750 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981322700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f497c0a4b50 0x7f497c05ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981322700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f497c0a4b50 0x7f497c05ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f497c0a5750 0x7f497c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4982324700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f497c05efa0 0x7f497c14ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39880/0 (socket says 172.21.15.129:39880) 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4982324700 1 -- 172.21.15.129:0/2008121263 learned_addr learned my addr 172.21.15.129:0/2008121263 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> v2:172.21.15.129:6791/0 conn(0x7f497c0a5750 0x7f497c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862210089 0 0) 0x7f497c0a5b80 con 0x7f497c05efa0 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f496c003230 con 0x7f497c05efa0 2020-01-26T15:24:35.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4050540712 0 0) 0x7f496c003230 con 0x7f497c05efa0 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 >> v2:172.21.15.129:6791/0 conn(0x7f497c0a5750 msgr2=0x7f497c0a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 --2- 172.21.15.129:0/2008121263 >> v2:172.21.15.129:6791/0 conn(0x7f497c0a5750 0x7f497c0a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 >> v2:172.21.15.129:6790/0 conn(0x7f497c0a4b50 msgr2=0x7f497c05ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 --2- 172.21.15.129:0/2008121263 >> v2:172.21.15.129:6790/0 conn(0x7f497c0a4b50 0x7f497c05ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c080440 con 0x7f497c05efa0 2020-01-26T15:24:35.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4974001710 con 0x7f497c05efa0 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 >> v1:172.21.15.129:6789/0 conn(0x7f497c05efa0 legacy=0x7f497c14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f496c003230 con 0x7f496c00a7f0 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f497c0a5b80 con 0x7f496c0045a0 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0a43f0 con 0x7f496c003860 2020-01-26T15:24:35.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212491412 0 0) 0x7f497c0a5b80 con 0x7f496c0045a0 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f496c00e520 con 0x7f496c0045a0 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222336846 0 0) 0x7f496c003230 con 0x7f496c00a7f0 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c0a5b80 con 0x7f496c00a7f0 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 -- 172.21.15.129:0/2008121263 >> v1:172.21.15.129:6791/0 conn(0x7f496c0045a0 legacy=0x7f496c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 -- 172.21.15.129:0/2008121263 >> v1:172.21.15.129:6790/0 conn(0x7f496c00a7f0 legacy=0x7f496c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 -- 172.21.15.129:0/2008121263 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c054470 con 0x7f496c003860 2020-01-26T15:24:35.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4982324700 1 -- 172.21.15.129:0/2008121263 reap_dead start 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4970008c80 tx=0x7f49700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4970008c80 tx=0x7f49700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f4970008c80 tx=0x7f49700101e0).ready entity=mon.0 client_cookie=fe62fb51af3b72c7 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f4970008c80 tx=0x7f49700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4970002240 con 0x7f496c003860 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f4970008c80 tx=0x7f49700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970002440 con 0x7f496c003860 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4981b23700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f4970008c80 tx=0x7f49700101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4980b21700 1 -- 172.21.15.129:0/2008121263 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4970002630 con 0x7f496c003860 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 -- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 msgr2=0x7f496c003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.018+0000 7f4983586700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f4970008c80 tx=0x7f49700101e0).stop 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- 172.21.15.129:0/2008121263 shutdown_connections 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 --2- 172.21.15.129:0/2008121263 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f496c003860 0x7f496c003cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- 172.21.15.129:0/2008121263 >> 172.21.15.129:0/2008121263 conn(0x7f497c05e050 msgr2=0x7f497c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- 172.21.15.129:0/2008121263 shutdown_connections 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- 172.21.15.129:0/2008121263 wait complete. 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 Processor -- start 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- start start 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f497c0647e0 0x7f497c12fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f497c130130 0x7f497c130560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c130ab0 con 0x7f497c0643b0 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f497c060540 con 0x7f497c130130 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4983586700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f497c060b40 con 0x7f497c0647e0 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4981322700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f497c0647e0 0x7f497c12fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4981b23700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f497c0643b0 0x7f497c061aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39888/0 (socket says 172.21.15.129:39888) 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4981b23700 1 -- 172.21.15.129:0/1340359474 learned_addr learned my addr 172.21.15.129:0/1340359474 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4981322700 1 --2- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6791/0 conn(0x7f497c0647e0 0x7f497c12fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4982324700 -1 --2- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6790/0 conn(0x7f497c130130 0x7f497c130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.022+0000 7f4982324700 1 --2- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6790/0 conn(0x7f497c130130 0x7f497c130560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871424794 0 0) 0x7f497c130ab0 con 0x7f497c0643b0 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4964003230 con 0x7f497c0643b0 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1484020594 0 0) 0x7f4964003230 con 0x7f497c0643b0 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f497c130ab0 con 0x7f497c0643b0 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4970008a00 con 0x7f497c0643b0 2020-01-26T15:24:35.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6791/0 conn(0x7f497c0647e0 msgr2=0x7f497c12fbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 --2- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6791/0 conn(0x7f497c0647e0 0x7f497c12fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6790/0 conn(0x7f497c130130 msgr2=0x7f497c130560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 --2- 172.21.15.129:0/1340359474 >> v2:172.21.15.129:6790/0 conn(0x7f497c130130 0x7f497c130560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 >> v1:172.21.15.129:6789/0 conn(0x7f497c0643b0 legacy=0x7f497c061aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4964003230 con 0x7f49640045a0 2020-01-26T15:24:35.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f496400f450 con 0x7f496400a7f0 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c060540 con 0x7f4964003a20 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960351633 0 0) 0x7f496400f450 con 0x7f496400a7f0 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f496400e440 con 0x7f496400a7f0 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953084385 0 0) 0x7f4964003230 con 0x7f49640045a0 2020-01-26T15:24:35.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 -- 172.21.15.129:0/1340359474 >> v1:172.21.15.129:6791/0 conn(0x7f496400a7f0 legacy=0x7f496400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 -- 172.21.15.129:0/1340359474 >> v1:172.21.15.129:6790/0 conn(0x7f49640045a0 legacy=0x7f49640049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c064030 con 0x7f4964003a20 2020-01-26T15:24:35.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4982324700 1 -- 172.21.15.129:0/1340359474 reap_dead start 2020-01-26T15:24:35.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c130130 con 0x7f4964003a20 2020-01-26T15:24:35.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c12fbe0 con 0x7f4964003a20 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f497000f8b0 con 0x7f4964003a20 2020-01-26T15:24:35.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000fab0 con 0x7f4964003a20 2020-01-26T15:24:35.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4970005b50 con 0x7f4964003a20 2020-01-26T15:24:35.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958003360 con 0x7f4964003a20 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f4970007160 con 0x7f4964003a20 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.026+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f497004e5b0 con 0x7f4964003a20 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.034+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.034+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f4970034760 con 0x7f4964003a20 2020-01-26T15:24:35.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.150+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49580021f0 con 0x7f4964003a20 2020-01-26T15:24:35.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.150+0000 7f4981b23700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.150+0000 7f497a7fc700 1 -- 172.21.15.129:0/1340359474 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+9080 (secure 0 0 0) 0x7f49700349c0 con 0x7f4964003a20 2020-01-26T15:24:35.154 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:35.154 INFO:teuthology.orchestra.run.smithi129.stdout:{"epoch":33,"fsid":"bb47bc39-5bc5-4332-898b-6fff3a2e822b","created":"2020-01-26T15:21:30.833373+0000","modified":"2020-01-26T15:24:34.237474+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"mimic","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-01-26T15:21:40.257840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-01-26T15:21:42.851862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-01-26T15:21:43.236142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"862905c0-6fd6-4e29-8d20-a16d92e67224","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":23,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6805","nonce":17867}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6806","nonce":17867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6808","nonce":17867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6807","nonce":17867}]},"public_addr":"172.21.15.129:6805/17867","cluster_addr":"172.21.15.129:6806/17867","heartbeat_back_addr":"172.21.15.129:6808/17867","heartbeat_front_addr":"172.21.15.129:6807/17867","state":["exists","up"]},{"osd":1,"uuid":"5366828c-d7f2-45d2-a018-d90c71b3d22a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":17,"up_from":21,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6801","nonce":17786}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6802","nonce":17786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6804","nonce":17786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6803","nonce":17786}]},"public_addr":"172.21.15.129:6801/17786","cluster_addr":"172.21.15.129:6802/17786","heartbeat_back_addr":"172.21.15.129:6804/17786","heartbeat_front_addr":"172.21.15.129:6803/17786","state":["exists","up"]},{"osd":2,"uuid":"a423dd2a-12e4-4cc9-9bfb-c75a8686b1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":25,"up_thru":25,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6813","nonce":18164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6814","nonce":18164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6816","nonce":18164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6815","nonce":18164}]},"public_addr":"172.21.15.129:6813/18164","cluster_addr":"172.21.15.129:6814/18164","heartbeat_back_addr":"172.21.15.129:6816/18164","heartbeat_front_addr":"172.21.15.129:6815/18164","state":["exists","up"]},{"osd":3,"uuid":"e13a3b22-4e52-4be6-b486-20cdf0ee7cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":24,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6809","nonce":17994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6810","nonce":17994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6812","nonce":17994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.129:6811","nonce":17994}]},"public_addr":"172.21.15.129:6809/17994","cluster_addr":"172.21.15.129:6810/17994","heartbeat_back_addr":"172.21.15.129:6812/17994","heartbeat_front_addr":"172.21.15.129:6811/17994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2020-01-26T15:24:18.422803+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.129:6819/2338999715":"2020-01-27T15:24:28.612769+0000","172.21.15.129:6800/11038":"2020-01-27T15:24:08.608968+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-01-26T15:24:35.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 >> v1:172.21.15.129:6800/16899 conn(0x7f4964040970 legacy=0x7f4964042e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 msgr2=0x7f4964003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f49700086c0 tx=0x7f497000f440).stop 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 shutdown_connections 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 --2- 172.21.15.129:0/1340359474 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4964003a20 0x7f4964003e90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 >> 172.21.15.129:0/1340359474 conn(0x7f497c05f680 msgr2=0x7f497c0a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 shutdown_connections 2020-01-26T15:24:35.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.154+0000 7f4983586700 1 -- 172.21.15.129:0/1340359474 wait complete. 2020-01-26T15:24:35.172 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-01-26T15:24:35.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 Processor -- start 2020-01-26T15:24:35.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 -- start start 2020-01-26T15:24:35.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 0x7f636005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 0x7f636007ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6360098000 con 0x7f63600804d0 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f636005e050 con 0x7f63600a6870 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f63600a6ca0 con 0x7f636005edd0 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f6365761700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f63600804d0 0x7f63600247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48206/0 (socket says 172.21.15.129:48206) 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635effd700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 0x7f636007ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f6365761700 1 -- 172.21.15.129:0/3645982177 learned_addr learned my addr 172.21.15.129:0/3645982177 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635f7fe700 -1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 0x7f636005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635effd700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 0x7f636007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635f7fe700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 0x7f636005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997127121 0 0) 0x7f6360098000 con 0x7f63600804d0 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6340003230 con 0x7f63600804d0 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4050405836 0 0) 0x7f6340003230 con 0x7f63600804d0 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 msgr2=0x7f636005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 0x7f636005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 msgr2=0x7f636007ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 0x7f636007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360024fb0 con 0x7f63600804d0 2020-01-26T15:24:35.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6358001710 con 0x7f63600804d0 2020-01-26T15:24:35.279 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6358001aa0 con 0x7f63600804d0 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635e7fc700 1 -- 172.21.15.129:0/3645982177 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6358004760 con 0x7f63600804d0 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.270+0000 7f635ffff700 1 -- 172.21.15.129:0/3645982177 >> v1:172.21.15.129:6790/0 conn(0x7f63600804d0 legacy=0x7f63600247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- 172.21.15.129:0/3645982177 shutdown_connections 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6791/0 conn(0x7f636005edd0 0x7f636005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 --2- 172.21.15.129:0/3645982177 >> v2:172.21.15.129:6790/0 conn(0x7f63600a6870 0x7f636007ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- 172.21.15.129:0/3645982177 >> 172.21.15.129:0/3645982177 conn(0x7f6360098e70 msgr2=0x7f63600a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- 172.21.15.129:0/3645982177 shutdown_connections 2020-01-26T15:24:35.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- 172.21.15.129:0/3645982177 wait complete. 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 Processor -- start 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- start start 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f6360063770 0x7f6360063ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636009f4a0 con 0x7f636007f2f0 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636007f720 con 0x7f636007eec0 2020-01-26T15:24:35.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635ffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f636009fdd0 con 0x7f6360063770 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635effd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f636007eec0 0x7f636012d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45826/0 (socket says 172.21.15.129:45826) 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635effd700 1 -- 172.21.15.129:0/1078401444 learned_addr learned my addr 172.21.15.129:0/1078401444 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635f7fe700 -1 --2- 172.21.15.129:0/1078401444 >> v2:172.21.15.129:6791/0 conn(0x7f6360063770 0x7f6360063ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f635f7fe700 1 --2- 172.21.15.129:0/1078401444 >> v2:172.21.15.129:6791/0 conn(0x7f6360063770 0x7f6360063ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876701064 0 0) 0x7f636007f720 con 0x7f636007eec0 2020-01-26T15:24:35.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6338003230 con 0x7f636007eec0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979126333 0 0) 0x7f636009f4a0 con 0x7f636007f2f0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.274+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f636007f720 con 0x7f636007f2f0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1070454020 0 0) 0x7f6338003230 con 0x7f636007eec0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f636009f4a0 con 0x7f636007eec0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6348001a60 con 0x7f636007eec0 2020-01-26T15:24:35.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3887720190 0 0) 0x7f636007f720 con 0x7f636007f2f0 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6338003230 con 0x7f636007f2f0 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63580046e0 con 0x7f636007f2f0 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 44845800 0 0) 0x7f636009f4a0 con 0x7f636007eec0 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 >> v2:172.21.15.129:6791/0 conn(0x7f6360063770 msgr2=0x7f6360063ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 --2- 172.21.15.129:0/1078401444 >> v2:172.21.15.129:6791/0 conn(0x7f6360063770 0x7f6360063ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 >> v1:172.21.15.129:6790/0 conn(0x7f636007f2f0 legacy=0x7f636012dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636013b1e0 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63601391c0 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6360139690 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6348002240 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6348002620 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6791/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6360056600 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f6348002820 con 0x7f636007eec0 2020-01-26T15:24:35.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7f634804bcd0 con 0x7f636007eec0 2020-01-26T15:24:35.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6805/17867 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6338048cc0 con 0x7f6338044f70 2020-01-26T15:24:35.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (unknown 758375209 0 0) 0x7f634804c150 con 0x7f636007eec0 2020-01-26T15:24:35.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.278+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== osd.0 v1:172.21.15.129:6805/17867 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f6338048cc0 con 0x7f6338044f70 2020-01-26T15:24:35.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 --> v1:172.21.15.129:6805/17867 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6360097dd0 con 0x7f6338044f70 2020-01-26T15:24:35.304 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f6357fff700 1 -- 172.21.15.129:0/1078401444 <== osd.0 v1:172.21.15.129:6805/17867 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2346018297) 0x7f6360097dd0 con 0x7f6338044f70 2020-01-26T15:24:35.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 >> v1:172.21.15.129:6805/17867 conn(0x7f6338044f70 legacy=0x7f6338047400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 >> v1:172.21.15.129:6800/16899 conn(0x7f633803e4e0 legacy=0x7f63380409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 >> v1:172.21.15.129:6791/0 conn(0x7f636007eec0 legacy=0x7f636012d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.305 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f6365761700 1 -- 172.21.15.129:0/1078401444 reap_dead start 2020-01-26T15:24:35.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 shutdown_connections 2020-01-26T15:24:35.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 >> 172.21.15.129:0/1078401444 conn(0x7f636005f140 msgr2=0x7f63600a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 shutdown_connections 2020-01-26T15:24:35.306 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.302+0000 7f635ffff700 1 -- 172.21.15.129:0/1078401444 wait complete. 2020-01-26T15:24:35.316 INFO:teuthology.orchestra.run.smithi129.stdout:98784247813 2020-01-26T15:24:35.317 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-01-26T15:24:35.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 Processor -- start 2020-01-26T15:24:35.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 -- start start 2020-01-26T15:24:35.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f41980a6870 0x7f419814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419805ea20 con 0x7f419805e5f0 2020-01-26T15:24:35.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4198098000 con 0x7f419805edd0 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419ca0c700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f419805e050 con 0x7f41980a6870 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419dc6e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f41980a6870 0x7f419814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f41977fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f419805e5f0 0x7f4198149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39918/0 (socket says 172.21.15.129:39918) 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f41977fe700 1 -- 172.21.15.129:0/2561995174 learned_addr learned my addr 172.21.15.129:0/2561995174 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> v2:172.21.15.129:6791/0 conn(0x7f41980a6870 0x7f419814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367656316 0 0) 0x7f4198098000 con 0x7f419805edd0 2020-01-26T15:24:35.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4184003230 con 0x7f419805edd0 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148102353 0 0) 0x7f419805ea20 con 0x7f419805e5f0 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4198098000 con 0x7f419805e5f0 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.430+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3839999879 0 0) 0x7f4198098000 con 0x7f419805e5f0 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 >> v2:172.21.15.129:6791/0 conn(0x7f41980a6870 msgr2=0x7f419814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 --2- 172.21.15.129:0/2561995174 >> v2:172.21.15.129:6791/0 conn(0x7f41980a6870 0x7f419814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 >> v1:172.21.15.129:6790/0 conn(0x7f419805edd0 legacy=0x7f419807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980a6ca0 con 0x7f419805e5f0 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f41880019f0 con 0x7f419805e5f0 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 >> v1:172.21.15.129:6789/0 conn(0x7f419805e5f0 legacy=0x7f4198149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4198098000 con 0x7f4184005000 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4184003230 con 0x7f4184004b50 2020-01-26T15:24:35.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419805e050 con 0x7f418400b800 2020-01-26T15:24:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105432794 0 0) 0x7f4184003230 con 0x7f4184004b50 2020-01-26T15:24:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f419805ea20 con 0x7f4184004b50 2020-01-26T15:24:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 -- 172.21.15.129:0/2561995174 >> v1:172.21.15.129:6791/0 conn(0x7f4184004b50 legacy=0x7f4184003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265076855 0 0) 0x7f4198098000 con 0x7f4184005000 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 -- 172.21.15.129:0/2561995174 >> v1:172.21.15.129:6790/0 conn(0x7f4184005000 legacy=0x7f4184003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 -- 172.21.15.129:0/2561995174 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184054520 con 0x7f418400b800 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4190002f30 tx=0x7f419000fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4190002f30 tx=0x7f419000fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f4190002f30 tx=0x7f419000fe40).ready entity=mon.0 client_cookie=938a598171cd86d1 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f4190002f30 tx=0x7f419000fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.446 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4190005ac0 con 0x7f418400b800 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f4190002f30 tx=0x7f419000fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f4190002f30 tx=0x7f419000fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190005cc0 con 0x7f418400b800 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f4196ffd700 1 -- 172.21.15.129:0/2561995174 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4190010900 con 0x7f418400b800 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 -- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 msgr2=0x7f418400dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 --2- 172.21.15.129:0/2561995174 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f418400b800 0x7f418400dc40 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f4190002f30 tx=0x7f419000fe40).stop 2020-01-26T15:24:35.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419dc6e700 1 -- 172.21.15.129:0/2561995174 reap_dead start 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 -- 172.21.15.129:0/2561995174 shutdown_connections 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 -- 172.21.15.129:0/2561995174 >> 172.21.15.129:0/2561995174 conn(0x7f4198098e70 msgr2=0x7f41980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 -- 172.21.15.129:0/2561995174 shutdown_connections 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.434+0000 7f419ca0c700 1 -- 172.21.15.129:0/2561995174 wait complete. 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 Processor -- start 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- start start 2020-01-26T15:24:35.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f41980a0c30 0x7f41980a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f41980a15b0 0x7f4198137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41980a00f0 con 0x7f419809fb70 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f419811f1b0 con 0x7f41980a0c30 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f41980a1b10 con 0x7f41980a15b0 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4197fff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f419809fb70 0x7f419807bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39928/0 (socket says 172.21.15.129:39928) 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4197fff700 1 -- 172.21.15.129:0/765227866 learned_addr learned my addr 172.21.15.129:0/765227866 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 -1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6791/0 conn(0x7f41980a15b0 0x7f4198137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f41977fe700 -1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6790/0 conn(0x7f41980a0c30 0x7f41980a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6791/0 conn(0x7f41980a15b0 0x7f4198137190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f41977fe700 1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6790/0 conn(0x7f41980a0c30 0x7f41980a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443693972 0 0) 0x7f41980a00f0 con 0x7f419809fb70 2020-01-26T15:24:35.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c003230 con 0x7f419809fb70 2020-01-26T15:24:35.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 605213933 0 0) 0x7f417c003230 con 0x7f419809fb70 2020-01-26T15:24:35.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f41980a00f0 con 0x7f419809fb70 2020-01-26T15:24:35.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4180001580 con 0x7f419809fb70 2020-01-26T15:24:35.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6791/0 conn(0x7f41980a15b0 msgr2=0x7f4198137190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6791/0 conn(0x7f41980a15b0 0x7f4198137190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6790/0 conn(0x7f41980a0c30 msgr2=0x7f41980a1060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 --2- 172.21.15.129:0/765227866 >> v2:172.21.15.129:6790/0 conn(0x7f41980a0c30 0x7f41980a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 >> v1:172.21.15.129:6789/0 conn(0x7f419809fb70 legacy=0x7f419807bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f417c003230 con 0x7f417c003a20 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f417c00f250 con 0x7f417c003f10 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419811f1b0 con 0x7f417c00b800 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549610748 0 0) 0x7f417c003230 con 0x7f417c003a20 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c00f480 con 0x7f417c003a20 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855498025 0 0) 0x7f417c00f250 con 0x7f417c003f10 2020-01-26T15:24:35.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c003230 con 0x7f417c003f10 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 -- 172.21.15.129:0/765227866 >> v1:172.21.15.129:6791/0 conn(0x7f417c003f10 legacy=0x7f417c004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 -- 172.21.15.129:0/765227866 >> v1:172.21.15.129:6790/0 conn(0x7f417c003a20 legacy=0x7f417c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 -- 172.21.15.129:0/765227866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419807c7b0 con 0x7f417c00b800 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41980a39d0 con 0x7f417c00b800 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419811fe30 con 0x7f417c00b800 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 -- 172.21.15.129:0/765227866 reap_dead start 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.438+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4190005b20 con 0x7f417c00b800 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190005d20 con 0x7f417c00b800 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f41900083b0 con 0x7f417c00b800 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41700035b0 con 0x7f417c00b800 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f41900085b0 con 0x7f417c00b800 2020-01-26T15:24:35.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f419dc6e700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f419004f630 con 0x7f417c00b800 2020-01-26T15:24:35.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6801/17786 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f417c04b300 con 0x7f417c0475d0 2020-01-26T15:24:35.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419004fab0 con 0x7f417c00b800 2020-01-26T15:24:35.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.442+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== osd.1 v1:172.21.15.129:6801/17786 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f417c04b300 con 0x7f417c0475d0 2020-01-26T15:24:35.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.462+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 --> v1:172.21.15.129:6801/17786 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41700026e0 con 0x7f417c0475d0 2020-01-26T15:24:35.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.462+0000 7f4194ff9700 1 -- 172.21.15.129:0/765227866 <== osd.1 v1:172.21.15.129:6801/17786 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1506399442) 0x7f41700026e0 con 0x7f417c0475d0 2020-01-26T15:24:35.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.462+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 >> v1:172.21.15.129:6801/17786 conn(0x7f417c0475d0 legacy=0x7f417c049a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 >> v1:172.21.15.129:6800/16899 conn(0x7f417c040bd0 legacy=0x7f417c0430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 msgr2=0x7f417c00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f419807fbe0 tx=0x7f419000f6f0).stop 2020-01-26T15:24:35.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 shutdown_connections 2020-01-26T15:24:35.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 --2- 172.21.15.129:0/765227866 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f417c00b800 0x7f417c00dc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 >> 172.21.15.129:0/765227866 conn(0x7f4198097af0 msgr2=0x7f419807df80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 shutdown_connections 2020-01-26T15:24:35.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.466+0000 7f419ca0c700 1 -- 172.21.15.129:0/765227866 wait complete. 2020-01-26T15:24:35.478 INFO:teuthology.orchestra.run.smithi129.stdout:90194313221 2020-01-26T15:24:35.479 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-01-26T15:24:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.590+0000 7fe946384700 1 Processor -- start 2020-01-26T15:24:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.590+0000 7fe946384700 1 -- start start 2020-01-26T15:24:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.590+0000 7fe946384700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 0x7fe94005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe940098000 con 0x7fe940149040 2020-01-26T15:24:35.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94005e050 con 0x7fe9400a6870 2020-01-26T15:24:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400a6ca0 con 0x7fe94005edd0 2020-01-26T15:24:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe945b83700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 0x7fe94005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe945b83700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 0x7fe94005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe945382700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fe9400a6870 0x7fe94007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45860/0 (socket says 172.21.15.129:45860) 2020-01-26T15:24:35.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe945382700 1 -- 172.21.15.129:0/450408469 learned_addr learned my addr 172.21.15.129:0/450408469 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe9475e6700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fe940149040 0x7fe94014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48248/0 (socket says 172.21.15.129:48248) 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377312307 0 0) 0x7fe940098000 con 0x7fe940149040 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92c003230 con 0x7fe940149040 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507997536 0 0) 0x7fe94005e050 con 0x7fe9400a6870 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe940098000 con 0x7fe9400a6870 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2428202519 0 0) 0x7fe940098000 con 0x7fe9400a6870 2020-01-26T15:24:35.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 msgr2=0x7fe94005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 --2- 172.21.15.129:0/450408469 >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 0x7fe94005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 >> v1:172.21.15.129:6790/0 conn(0x7fe940149040 legacy=0x7fe94014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94014ecb0 con 0x7fe9400a6870 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe9300016f0 con 0x7fe9400a6870 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe930001940 con 0x7fe9400a6870 2020-01-26T15:24:35.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe944b81700 1 -- 172.21.15.129:0/450408469 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe9300045b0 con 0x7fe9400a6870 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- 172.21.15.129:0/450408469 >> v1:172.21.15.129:6791/0 conn(0x7fe9400a6870 legacy=0x7fe94007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- 172.21.15.129:0/450408469 shutdown_connections 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 --2- 172.21.15.129:0/450408469 >> v2:172.21.15.129:6790/0 conn(0x7fe94005edd0 0x7fe94005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- 172.21.15.129:0/450408469 >> 172.21.15.129:0/450408469 conn(0x7fe940098e70 msgr2=0x7fe9400a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- 172.21.15.129:0/450408469 shutdown_connections 2020-01-26T15:24:35.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.594+0000 7fe946384700 1 -- 172.21.15.129:0/450408469 wait complete. 2020-01-26T15:24:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 Processor -- start 2020-01-26T15:24:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- start start 2020-01-26T15:24:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94007d3c0 con 0x7fe940099bb0 2020-01-26T15:24:35.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe940122a40 con 0x7fe9400a0e80 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400a12b0 con 0x7fe940137340 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9475e6700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fe940137340 0x7fe940139780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45868/0 (socket says 172.21.15.129:45868) 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9475e6700 1 -- 172.21.15.129:0/1250933532 learned_addr learned my addr 172.21.15.129:0/1250933532 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742477820 0 0) 0x7fe9400a12b0 con 0x7fe940137340 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe928003230 con 0x7fe940137340 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574947864 0 0) 0x7fe94007d3c0 con 0x7fe940099bb0 2020-01-26T15:24:35.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9400a12b0 con 0x7fe940099bb0 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542163073 0 0) 0x7fe940122a40 con 0x7fe9400a0e80 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe94007d3c0 con 0x7fe9400a0e80 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 927591467 0 0) 0x7fe9400a12b0 con 0x7fe940099bb0 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe940122a40 con 0x7fe940099bb0 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe930001940 con 0x7fe940099bb0 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6791/0 conn(0x7fe940137340 legacy=0x7fe940139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.608 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6790/0 conn(0x7fe9400a0e80 legacy=0x7fe94007c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6789/0 conn(0x7fe940099bb0 legacy=0x7fe940099fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe9400a12b0 con 0x7fe928004f20 2020-01-26T15:24:35.609 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe928005350 con 0x7fe928004af0 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280108a0 con 0x7fe928003e60 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110771129 0 0) 0x7fe928005350 con 0x7fe928004af0 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92800e810 con 0x7fe928004af0 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889633511 0 0) 0x7fe9400a12b0 con 0x7fe928004f20 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe928005350 con 0x7fe928004f20 2020-01-26T15:24:35.610 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6791/0 conn(0x7fe928004af0 legacy=0x7fe9280097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6790/0 conn(0x7fe928004f20 legacy=0x7fe92800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 -- 172.21.15.129:0/1250933532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94009fb70 con 0x7fe928003e60 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400a0e80 con 0x7fe928003e60 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94007c7c0 con 0x7fe928003e60 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe93c011890 con 0x7fe928003e60 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c011a90 con 0x7fe928003e60 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.598+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe93c00a240 con 0x7fe928003e60 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe91c0035b0 con 0x7fe928003e60 2020-01-26T15:24:35.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe93c00a520 con 0x7fe928003e60 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe945b83700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7fe93c04d760 con 0x7fe928003e60 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6813/18164 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe928052e00 con 0x7fe92804f0b0 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93c04db70 con 0x7fe928003e60 2020-01-26T15:24:35.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.602+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== osd.2 v1:172.21.15.129:6813/18164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7fe928052e00 con 0x7fe92804f0b0 2020-01-26T15:24:35.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 --> v1:172.21.15.129:6813/18164 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe91c0026e0 con 0x7fe92804f0b0 2020-01-26T15:24:35.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe9367fc700 1 -- 172.21.15.129:0/1250933532 <== osd.2 v1:172.21.15.129:6813/18164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 662925176) 0x7fe91c0026e0 con 0x7fe92804f0b0 2020-01-26T15:24:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6813/18164 conn(0x7fe92804f0b0 legacy=0x7fe928051540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 >> v1:172.21.15.129:6800/16899 conn(0x7fe928048680 legacy=0x7fe92804ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe9475e6700 1 -- 172.21.15.129:0/1250933532 reap_dead start 2020-01-26T15:24:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 msgr2=0x7fe9280045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.622+0000 7fe946384700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe93c002320 tx=0x7fe93c010f40).stop 2020-01-26T15:24:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.626+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 shutdown_connections 2020-01-26T15:24:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.626+0000 7fe946384700 1 --2- 172.21.15.129:0/1250933532 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe928003e60 0x7fe9280045a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.626+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 >> 172.21.15.129:0/1250933532 conn(0x7fe94005ef50 msgr2=0x7fe94007f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.626+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 shutdown_connections 2020-01-26T15:24:35.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.626+0000 7fe946384700 1 -- 172.21.15.129:0/1250933532 wait complete. 2020-01-26T15:24:35.642 INFO:teuthology.orchestra.run.smithi129.stdout:107374182404 2020-01-26T15:24:35.643 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-01-26T15:24:35.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.746+0000 7f1fcdafc700 1 Processor -- start 2020-01-26T15:24:35.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.746+0000 7f1fcdafc700 1 -- start start 2020-01-26T15:24:35.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 0x7f1fc805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 0x7f1fc807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc8098000 con 0x7f1fc80804d0 2020-01-26T15:24:35.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc805e050 con 0x7f1fc80a6870 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc80a6ca0 con 0x7f1fc805edd0 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fccafa700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 0x7f1fc807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fced5e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1fc80804d0 0x7f1fc80247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48270/0 (socket says 172.21.15.129:48270) 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcd2fb700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 0x7f1fc805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fced5e700 1 -- 172.21.15.129:0/1890144394 learned_addr learned my addr 172.21.15.129:0/1890144394 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fccafa700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 0x7f1fc807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcd2fb700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 0x7f1fc805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467520760 0 0) 0x7f1fc8098000 con 0x7f1fc80804d0 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb0003230 con 0x7f1fc80804d0 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3968652257 0 0) 0x7f1fb0003230 con 0x7f1fc80804d0 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 msgr2=0x7f1fc805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 0x7f1fc805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 msgr2=0x7f1fc807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 0x7f1fc807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8024fb0 con 0x7f1fc80804d0 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1fc0001710 con 0x7f1fc80804d0 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1fc0001aa0 con 0x7f1fc80804d0 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fc7fff700 1 -- 172.21.15.129:0/1890144394 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1fc0004760 con 0x7f1fc80804d0 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- 172.21.15.129:0/1890144394 >> v1:172.21.15.129:6790/0 conn(0x7f1fc80804d0 legacy=0x7f1fc80247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- 172.21.15.129:0/1890144394 shutdown_connections 2020-01-26T15:24:35.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6791/0 conn(0x7f1fc805edd0 0x7f1fc805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 --2- 172.21.15.129:0/1890144394 >> v2:172.21.15.129:6790/0 conn(0x7f1fc80a6870 0x7f1fc807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- 172.21.15.129:0/1890144394 >> 172.21.15.129:0/1890144394 conn(0x7f1fc8098e70 msgr2=0x7f1fc80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- 172.21.15.129:0/1890144394 shutdown_connections 2020-01-26T15:24:35.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.750+0000 7f1fcdafc700 1 -- 172.21.15.129:0/1890144394 wait complete. 2020-01-26T15:24:35.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 Processor -- start 2020-01-26T15:24:35.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 -- start start 2020-01-26T15:24:35.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1fc807f040 0x7f1fc807f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc809e610 con 0x7f1fc809a1e0 2020-01-26T15:24:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc809a610 con 0x7f1fc811f600 2020-01-26T15:24:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcdafc700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc811fc80 con 0x7f1fc807f040 2020-01-26T15:24:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcd2fb700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f1fc811f600 0x7f1fc80a42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45888/0 (socket says 172.21.15.129:45888) 2020-01-26T15:24:35.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fcd2fb700 1 -- 172.21.15.129:0/3294816679 learned_addr learned my addr 172.21.15.129:0/3294816679 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fccafa700 -1 --2- 172.21.15.129:0/3294816679 >> v2:172.21.15.129:6790/0 conn(0x7f1fc807f040 0x7f1fc807f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> v2:172.21.15.129:6790/0 conn(0x7f1fc807f040 0x7f1fc807f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855314736 0 0) 0x7f1fc809a610 con 0x7f1fc811f600 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa8003230 con 0x7f1fc811f600 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052714329 0 0) 0x7f1fc809e610 con 0x7f1fc809a1e0 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc809a610 con 0x7f1fc809a1e0 2020-01-26T15:24:35.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3426034333 0 0) 0x7f1fc809a610 con 0x7f1fc809a1e0 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1fc809e610 con 0x7f1fc809a1e0 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1fc0004760 con 0x7f1fc809a1e0 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 >> v2:172.21.15.129:6790/0 conn(0x7f1fc807f040 msgr2=0x7f1fc807f470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 --2- 172.21.15.129:0/3294816679 >> v2:172.21.15.129:6790/0 conn(0x7f1fc807f040 0x7f1fc807f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6791/0 conn(0x7f1fc811f600 legacy=0x7f1fc80a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6789/0 conn(0x7f1fc809a1e0 legacy=0x7f1fc81370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1fa8003230 con 0x7f1fa8004c90 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1fc809a610 con 0x7f1fa800a7f0 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc811fc80 con 0x7f1fa80050c0 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153301385 0 0) 0x7f1fc809a610 con 0x7f1fa800a7f0 2020-01-26T15:24:35.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa800e440 con 0x7f1fa800a7f0 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177747833 0 0) 0x7f1fa8003230 con 0x7f1fa8004c90 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.754+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc809a610 con 0x7f1fa8004c90 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6791/0 conn(0x7f1fa800a7f0 legacy=0x7f1fa800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6790/0 conn(0x7f1fa8004c90 legacy=0x7f1fa8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 -- 172.21.15.129:0/3294816679 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc809a840 con 0x7f1fa80050c0 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc809aab0 con 0x7f1fa80050c0 2020-01-26T15:24:35.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc811f600 con 0x7f1fa80050c0 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1fbc009d70 con 0x7f1fa80050c0 2020-01-26T15:24:35.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc007990 con 0x7f1fa80050c0 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1fbc005760 con 0x7f1fa80050c0 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fa00035b0 con 0x7f1fa80050c0 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1fbc005a70 con 0x7f1fa80050c0 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fccafa700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:35.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f1fbc04d020 con 0x7f1fa80050c0 2020-01-26T15:24:35.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6809/17994 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fa8054b70 con 0x7f1fa8050e20 2020-01-26T15:24:35.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.758+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fbc04d430 con 0x7f1fa80050c0 2020-01-26T15:24:35.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.762+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== osd.3 v1:172.21.15.129:6809/17994 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (unknown 0 0 481134768) 0x7f1fa8054b70 con 0x7f1fa8050e20 2020-01-26T15:24:35.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 --> v1:172.21.15.129:6809/17994 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fa00026e0 con 0x7f1fa8050e20 2020-01-26T15:24:35.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fc5ffb700 1 -- 172.21.15.129:0/3294816679 <== osd.3 v1:172.21.15.129:6809/17994 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3404885766) 0x7f1fa00026e0 con 0x7f1fa8050e20 2020-01-26T15:24:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6809/17994 conn(0x7f1fa8050e20 legacy=0x7f1fa80532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fced5e700 1 -- 172.21.15.129:0/3294816679 reap_dead start 2020-01-26T15:24:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 >> v1:172.21.15.129:6800/16899 conn(0x7f1fa804a3e0 legacy=0x7f1fa804c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 msgr2=0x7f1fa8003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f1fbc002f30 tx=0x7f1fbc010a80).stop 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 shutdown_connections 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 --2- 172.21.15.129:0/3294816679 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1fa80050c0 0x7f1fa8003d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 >> 172.21.15.129:0/3294816679 conn(0x7f1fc80a5520 msgr2=0x7f1fc8123860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 shutdown_connections 2020-01-26T15:24:35.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.782+0000 7f1fcdafc700 1 -- 172.21.15.129:0/3294816679 wait complete. 2020-01-26T15:24:35.801 INFO:teuthology.orchestra.run.smithi129.stdout:103079215109 2020-01-26T15:24:35.801 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:35.916 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 Processor -- start 2020-01-26T15:24:35.916 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 -- start start 2020-01-26T15:24:35.916 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 0x7f0ee405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 0x7f0ee407ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee4098000 con 0x7f0ee40804d0 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee405e050 con 0x7f0ee40a6870 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee359e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40a6ca0 con 0x7f0ee405edd0 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee2d9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 0x7f0ee405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee2d9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 0x7f0ee405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee259c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 0x7f0ee407ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee8a8b700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f0ee40804d0 0x7f0ee40247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48292/0 (socket says 172.21.15.129:48292) 2020-01-26T15:24:35.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.906+0000 7f0ee8a8b700 1 -- 172.21.15.129:0/473586901 learned_addr learned my addr 172.21.15.129:0/473586901 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee259c700 1 --2- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 0x7f0ee407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576480542 0 0) 0x7f0ee4098000 con 0x7f0ee40804d0 2020-01-26T15:24:35.918 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ecc003230 con 0x7f0ee40804d0 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 660063220 0 0) 0x7f0ecc003230 con 0x7f0ee40804d0 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 msgr2=0x7f0ee405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 --2- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 0x7f0ee405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 msgr2=0x7f0ee407ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 --2- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 0x7f0ee407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4024fb0 con 0x7f0ee40804d0 2020-01-26T15:24:35.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0edc001710 con 0x7f0ee40804d0 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0edc001aa0 con 0x7f0ee40804d0 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee1d9b700 1 -- 172.21.15.129:0/473586901 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0edc004760 con 0x7f0ee40804d0 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- 172.21.15.129:0/473586901 >> v1:172.21.15.129:6790/0 conn(0x7f0ee40804d0 legacy=0x7f0ee40247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- 172.21.15.129:0/473586901 shutdown_connections 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 --2- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6791/0 conn(0x7f0ee405edd0 0x7f0ee405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 --2- 172.21.15.129:0/473586901 >> v2:172.21.15.129:6790/0 conn(0x7f0ee40a6870 0x7f0ee407ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:35.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- 172.21.15.129:0/473586901 >> 172.21.15.129:0/473586901 conn(0x7f0ee4098e70 msgr2=0x7f0ee40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- 172.21.15.129:0/473586901 shutdown_connections 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- 172.21.15.129:0/473586901 wait complete. 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 Processor -- start 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- start start 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 0x7f0ee413bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40a3dd0 con 0x7f0ee40a39a0 2020-01-26T15:24:35.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40a1ae0 con 0x7f0ee40a3570 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee409e580 con 0x7f0ee4139a60 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee259c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f0ee40a39a0 0x7f0ee407a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:39996/0 (socket says 172.21.15.129:39996) 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.910+0000 7f0ee259c700 1 -- 172.21.15.129:0/872397329 learned_addr learned my addr 172.21.15.129:0/872397329 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ee8a8b700 -1 --2- 172.21.15.129:0/872397329 >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 0x7f0ee413bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ee8a8b700 1 --2- 172.21.15.129:0/872397329 >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 0x7f0ee413bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003811703 0 0) 0x7f0ee40a1ae0 con 0x7f0ee40a3570 2020-01-26T15:24:35.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec8003230 con 0x7f0ee40a3570 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640273457 0 0) 0x7f0ed8001f20 con 0x7f0ee40a39a0 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee40a1ae0 con 0x7f0ee40a39a0 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3325520431 0 0) 0x7f0ec8003230 con 0x7f0ee40a3570 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ed8001f20 con 0x7f0ee40a3570 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ed4002a70 con 0x7f0ee40a3570 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1193335219 0 0) 0x7f0ed8001f20 con 0x7f0ee40a3570 2020-01-26T15:24:35.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 msgr2=0x7f0ee413bea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 --2- 172.21.15.129:0/872397329 >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 0x7f0ee413bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 >> v1:172.21.15.129:6789/0 conn(0x7f0ee40a39a0 legacy=0x7f0ee407a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee409f300 con 0x7f0ee40a3570 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee409e150 con 0x7f0ee40a3570 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee4120510 con 0x7f0ee40a3570 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ed4001320 con 0x7f0ee40a3570 2020-01-26T15:24:35.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ed4001740 con 0x7f0ee40a3570 2020-01-26T15:24:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ebc003360 con 0x7f0ee40a3570 2020-01-26T15:24:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f0ed4001940 con 0x7f0ee40a3570 2020-01-26T15:24:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.914+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7f0ed404bd90 con 0x7f0ee40a3570 2020-01-26T15:24:35.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:35.918+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f0ed4031310 con 0x7f0ee40a3570 2020-01-26T15:24:36.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ebc0021f0 con 0x7f0ee40a3570 2020-01-26T15:24:36.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ed37fe700 1 -- 172.21.15.129:0/872397329 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 4078424467) 0x7f0ed404aa60 con 0x7f0ee40a3570 2020-01-26T15:24:36.040 INFO:teuthology.orchestra.run.smithi129.stdout:98784247812 2020-01-26T15:24:36.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 >> v1:172.21.15.129:6800/16899 conn(0x7f0ec803e210 legacy=0x7f0ec8040720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:36.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 >> v1:172.21.15.129:6790/0 conn(0x7f0ee40a3570 legacy=0x7f0ee40799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:36.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 shutdown_connections 2020-01-26T15:24:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 --2- 172.21.15.129:0/872397329 >> v2:172.21.15.129:6790/0 conn(0x7f0ee4139a60 0x7f0ee413bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 >> 172.21.15.129:0/872397329 conn(0x7f0ee40a7aa0 msgr2=0x7f0ee407e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 shutdown_connections 2020-01-26T15:24:36.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:36.038+0000 7f0ee359e700 1 -- 172.21.15.129:0/872397329 wait complete. 2020-01-26T15:24:36.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.0 2020-01-26T15:24:37.059 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-01-26T15:24:37.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.178+0000 7fc6ff33e700 1 Processor -- start 2020-01-26T15:24:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.178+0000 7fc6ff33e700 1 -- start start 2020-01-26T15:24:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 0x7fc6f805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 0x7fc6f807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8098000 con 0x7fc6f80804d0 2020-01-26T15:24:37.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f805e050 con 0x7fc6f805edd0 2020-01-26T15:24:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80a6ca0 con 0x7fc6f80a6870 2020-01-26T15:24:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6feb3d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 0x7fc6f805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6feb3d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 0x7fc6f805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fe33c700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 0x7fc6f807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:37.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fe33c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 0x7fc6f807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc7005a0700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fc6f80804d0 0x7fc6f80247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45922/0 (socket says 172.21.15.129:45922) 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc7005a0700 1 -- 172.21.15.129:0/1307717267 learned_addr learned my addr 172.21.15.129:0/1307717267 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130492863 0 0) 0x7fc6f8098000 con 0x7fc6f80804d0 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e0003230 con 0x7fc6f80804d0 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4267415056 0 0) 0x7fc6e0003230 con 0x7fc6f80804d0 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 msgr2=0x7fc6f807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 --2- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 0x7fc6f807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 msgr2=0x7fc6f805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 --2- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 0x7fc6f805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8024fb0 con 0x7fc6f80804d0 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc6e8001710 con 0x7fc6f80804d0 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc6e8001aa0 con 0x7fc6f80804d0 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- 172.21.15.129:0/1307717267 >> v1:172.21.15.129:6791/0 conn(0x7fc6f80804d0 legacy=0x7fc6f80247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6fdb3b700 1 -- 172.21.15.129:0/1307717267 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc6e8004760 con 0x7fc6f80804d0 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- 172.21.15.129:0/1307717267 shutdown_connections 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 --2- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6790/0 conn(0x7fc6f805edd0 0x7fc6f805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 --2- 172.21.15.129:0/1307717267 >> v2:172.21.15.129:6791/0 conn(0x7fc6f80a6870 0x7fc6f807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- 172.21.15.129:0/1307717267 >> 172.21.15.129:0/1307717267 conn(0x7fc6f8098e70 msgr2=0x7fc6f80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- 172.21.15.129:0/1307717267 shutdown_connections 2020-01-26T15:24:37.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.182+0000 7fc6ff33e700 1 -- 172.21.15.129:0/1307717267 wait complete. 2020-01-26T15:24:37.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 Processor -- start 2020-01-26T15:24:37.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- start start 2020-01-26T15:24:37.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 0x7fc6f81337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:37.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8096160 con 0x7fc6f80957b0 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8133d20 con 0x7fc6f8065890 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f8064750 con 0x7fc6f8095d30 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6feb3d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fc6f80957b0 0x7fc6f80a31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48308/0 (socket says 172.21.15.129:48308) 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc7005a0700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 0x7fc6f81337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6feb3d700 1 -- 172.21.15.129:0/123438176 learned_addr learned my addr 172.21.15.129:0/123438176 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc7005a0700 1 --2- 172.21.15.129:0/123438176 >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 0x7fc6f81337d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374041761 0 0) 0x7fc6f8096160 con 0x7fc6f80957b0 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d8003230 con 0x7fc6f80957b0 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34962320 0 0) 0x7fc6f8133d20 con 0x7fc6f8065890 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f8096160 con 0x7fc6f8065890 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2354595209 0 0) 0x7fc6d8003230 con 0x7fc6f80957b0 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6f8133d20 con 0x7fc6f80957b0 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc6f0002b00 con 0x7fc6f80957b0 2020-01-26T15:24:37.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4293598106 0 0) 0x7fc6f8096160 con 0x7fc6f8065890 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc6d8003230 con 0x7fc6f8065890 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc6ec0015d0 con 0x7fc6f8065890 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1266165169 0 0) 0x7fc6f8133d20 con 0x7fc6f80957b0 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 msgr2=0x7fc6f81337d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 --2- 172.21.15.129:0/123438176 >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 0x7fc6f81337d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 >> v1:172.21.15.129:6791/0 conn(0x7fc6f8065890 legacy=0x7fc6f8132fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80a2300 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f813b700 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f813bbd0 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc6f0001290 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc6f0001670 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.186+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fc6f00018f0 con 0x7fc6f80957b0 2020-01-26T15:24:37.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.190+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d4003360 con 0x7fc6f80957b0 2020-01-26T15:24:37.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.190+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7fc6f004be40 con 0x7fc6f80957b0 2020-01-26T15:24:37.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.194+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fc6f00313c0 con 0x7fc6f80957b0 2020-01-26T15:24:37.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.314+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6d40037e0 con 0x7fc6f80957b0 2020-01-26T15:24:37.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.314+0000 7fc6f77fe700 1 -- 172.21.15.129:0/123438176 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 3769977316) 0x7fc6f004ab10 con 0x7fc6f80957b0 2020-01-26T15:24:37.318 INFO:teuthology.orchestra.run.smithi129.stdout:98784247813 2020-01-26T15:24:37.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 >> v1:172.21.15.129:6800/16899 conn(0x7fc6d803e470 legacy=0x7fc6d8040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 >> v1:172.21.15.129:6790/0 conn(0x7fc6f80957b0 legacy=0x7fc6f80a31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 shutdown_connections 2020-01-26T15:24:37.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 --2- 172.21.15.129:0/123438176 >> v2:172.21.15.129:6790/0 conn(0x7fc6f8095d30 0x7fc6f81337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 >> 172.21.15.129:0/123438176 conn(0x7fc6f8025490 msgr2=0x7fc6f8097990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 shutdown_connections 2020-01-26T15:24:37.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.318+0000 7fc6ff33e700 1 -- 172.21.15.129:0/123438176 wait complete. 2020-01-26T15:24:37.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247813 for osd.0 2020-01-26T15:24:37.331 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-01-26T15:24:37.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 Processor -- start 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 -- start start 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 0x7f314814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314805ea20 con 0x7f314805e5f0 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3148098000 con 0x7f314805edd0 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314dd1a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f314805e050 con 0x7f31480a6870 2020-01-26T15:24:37.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314ef7c700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 0x7f314814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314d519700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f314805edd0 0x7f314807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45932/0 (socket says 172.21.15.129:45932) 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314d519700 1 -- 172.21.15.129:0/1374245134 learned_addr learned my addr 172.21.15.129:0/1374245134 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.442+0000 7f314ef7c700 1 --2- 172.21.15.129:0/1374245134 >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 0x7f314814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617767322 0 0) 0x7f314805ea20 con 0x7f314805e5f0 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3134003230 con 0x7f314805e5f0 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845290843 0 0) 0x7f3148098000 con 0x7f314805edd0 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f314805ea20 con 0x7f314805edd0 2020-01-26T15:24:37.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 297761915 0 0) 0x7f314805ea20 con 0x7f314805edd0 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 msgr2=0x7f314814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 --2- 172.21.15.129:0/1374245134 >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 0x7f314814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 >> v1:172.21.15.129:6790/0 conn(0x7f314805e5f0 legacy=0x7f3148149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480a6ca0 con 0x7f314805edd0 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f31440016f0 con 0x7f314805edd0 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3144001940 con 0x7f314805edd0 2020-01-26T15:24:37.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f313bfff700 1 -- 172.21.15.129:0/1374245134 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f31440045b0 con 0x7f314805edd0 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- 172.21.15.129:0/1374245134 >> v1:172.21.15.129:6791/0 conn(0x7f314805edd0 legacy=0x7f314807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- 172.21.15.129:0/1374245134 shutdown_connections 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 --2- 172.21.15.129:0/1374245134 >> v2:172.21.15.129:6791/0 conn(0x7f31480a6870 0x7f314814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- 172.21.15.129:0/1374245134 >> 172.21.15.129:0/1374245134 conn(0x7f3148098e70 msgr2=0x7f31480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- 172.21.15.129:0/1374245134 shutdown_connections 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- 172.21.15.129:0/1374245134 wait complete. 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 Processor -- start 2020-01-26T15:24:37.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- start start 2020-01-26T15:24:37.456 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 0x7f314811ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314811fd10 con 0x7f3148079e00 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3148121d30 con 0x7f3148121900 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314dd1a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f314811f880 con 0x7f314811e890 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314ef7c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 0x7f314811ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314cd18700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f3148121900 0x7f314811e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45940/0 (socket says 172.21.15.129:45940) 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314cd18700 1 -- 172.21.15.129:0/1079672820 learned_addr learned my addr 172.21.15.129:0/1079672820 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.446+0000 7f314ef7c700 1 --2- 172.21.15.129:0/1079672820 >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 0x7f314811ecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144885470 0 0) 0x7f3148121d30 con 0x7f3148121900 2020-01-26T15:24:37.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3128003230 con 0x7f3148121900 2020-01-26T15:24:37.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832750707 0 0) 0x7f314811fd10 con 0x7f3148079e00 2020-01-26T15:24:37.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3148121d30 con 0x7f3148079e00 2020-01-26T15:24:37.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 623426132 0 0) 0x7f3128003230 con 0x7f3148121900 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f314811fd10 con 0x7f3148121900 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f313c001960 con 0x7f3148121900 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 199445042 0 0) 0x7f3148121d30 con 0x7f3148079e00 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3128003230 con 0x7f3148079e00 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3144001940 con 0x7f3148079e00 2020-01-26T15:24:37.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3291966328 0 0) 0x7f314811fd10 con 0x7f3148121900 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 msgr2=0x7f314811ecc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 --2- 172.21.15.129:0/1079672820 >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 0x7f314811ecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 >> v1:172.21.15.129:6790/0 conn(0x7f3148079e00 legacy=0x7f3148122ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314811f210 con 0x7f3148121900 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314811f480 con 0x7f3148121900 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31481398b0 con 0x7f3148121900 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f313c001ef0 con 0x7f3148121900 2020-01-26T15:24:37.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f313c004900 con 0x7f3148121900 2020-01-26T15:24:37.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3148056600 con 0x7f3148121900 2020-01-26T15:24:37.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f313c010380 con 0x7f3148121900 2020-01-26T15:24:37.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.450+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7f313c04b910 con 0x7f3148121900 2020-01-26T15:24:37.461 INFO:tasks.ceph.mds.c.smithi129.stderr:2020-01-26T15:24:37.454+0000 7f835884b700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:24:37.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.458+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f313c030e30 con 0x7f3148121900 2020-01-26T15:24:37.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f314805cc60 con 0x7f3148121900 2020-01-26T15:24:37.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f3139ffb700 1 -- 172.21.15.129:0/1079672820 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 1498640560) 0x7f313c04a580 con 0x7f3148121900 2020-01-26T15:24:37.581 INFO:teuthology.orchestra.run.smithi129.stdout:90194313221 2020-01-26T15:24:37.582 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 >> v1:172.21.15.129:6800/16899 conn(0x7f312803e510 legacy=0x7f3128040a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.582 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 >> v1:172.21.15.129:6791/0 conn(0x7f3148121900 legacy=0x7f314811e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.582 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 shutdown_connections 2020-01-26T15:24:37.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 --2- 172.21.15.129:0/1079672820 >> v2:172.21.15.129:6790/0 conn(0x7f314811e890 0x7f314811ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 >> 172.21.15.129:0/1079672820 conn(0x7f31480249c0 msgr2=0x7f31480a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 shutdown_connections 2020-01-26T15:24:37.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.578+0000 7f314dd1a700 1 -- 172.21.15.129:0/1079672820 wait complete. 2020-01-26T15:24:37.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.1 2020-01-26T15:24:37.602 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-01-26T15:24:37.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 Processor -- start 2020-01-26T15:24:37.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 -- start start 2020-01-26T15:24:37.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc78005edd0 0x7fc78005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc780149040 0x7fc78014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780098000 con 0x7fc7800a6870 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc78005e050 con 0x7fc78005edd0 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77f59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc7800a6ca0 con 0x7fc780149040 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77ed9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc78005edd0 0x7fc78005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77ed9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc78005edd0 0x7fc78005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc784903700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc780149040 0x7fc78014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:37.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc784903700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc780149040 0x7fc78014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77e59c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc7800a6870 0x7fc78007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40032/0 (socket says 172.21.15.129:40032) 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.706+0000 7fc77e59c700 1 -- 172.21.15.129:0/1025791008 learned_addr learned my addr 172.21.15.129:0/1025791008 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056535849 0 0) 0x7fc780098000 con 0x7fc7800a6870 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c003230 con 0x7fc7800a6870 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2249047118 0 0) 0x7fc76c003230 con 0x7fc7800a6870 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 >> v2:172.21.15.129:6791/0 conn(0x7fc780149040 msgr2=0x7fc78014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 --2- 172.21.15.129:0/1025791008 >> v2:172.21.15.129:6791/0 conn(0x7fc780149040 0x7fc78014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 >> v2:172.21.15.129:6790/0 conn(0x7fc78005edd0 msgr2=0x7fc78005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 --2- 172.21.15.129:0/1025791008 >> v2:172.21.15.129:6790/0 conn(0x7fc78005edd0 0x7fc78005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78014c9e0 con 0x7fc7800a6870 2020-01-26T15:24:37.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc768001710 con 0x7fc7800a6870 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 >> v1:172.21.15.129:6789/0 conn(0x7fc7800a6870 legacy=0x7fc78007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc76c003230 con 0x7fc76c003860 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc780098000 con 0x7fc76c0077d0 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78005e050 con 0x7fc76c00b5a0 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855336343 0 0) 0x7fc76c003230 con 0x7fc76c003860 2020-01-26T15:24:37.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c00f300 con 0x7fc76c003860 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175920970 0 0) 0x7fc780098000 con 0x7fc76c0077d0 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 -- 172.21.15.129:0/1025791008 >> v1:172.21.15.129:6791/0 conn(0x7fc76c0077d0 legacy=0x7fc76c009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 -- 172.21.15.129:0/1025791008 >> v1:172.21.15.129:6790/0 conn(0x7fc76c003860 legacy=0x7fc76c003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 -- 172.21.15.129:0/1025791008 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c054460 con 0x7fc76c00b5a0 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc778002f30 tx=0x7fc77800fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 -- 172.21.15.129:0/1025791008 reap_dead start 2020-01-26T15:24:37.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc778002f30 tx=0x7fc77800fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fc778002f30 tx=0x7fc77800fe40).ready entity=mon.0 client_cookie=d0bc600d3b9dd15b server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fc778002f30 tx=0x7fc77800fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc778005ac0 con 0x7fc76c00b5a0 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fc778002f30 tx=0x7fc77800fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778005cc0 con 0x7fc76c00b5a0 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc784903700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7fc778002f30 tx=0x7fc77800fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77dd9b700 1 -- 172.21.15.129:0/1025791008 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc778010900 con 0x7fc76c00b5a0 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 -- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 msgr2=0x7fc76c00dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fc778002f30 tx=0x7fc77800fe40).stop 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 -- 172.21.15.129:0/1025791008 shutdown_connections 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 --2- 172.21.15.129:0/1025791008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc76c00b5a0 0x7fc76c00dab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 -- 172.21.15.129:0/1025791008 >> 172.21.15.129:0/1025791008 conn(0x7fc780098e70 msgr2=0x7fc7800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 -- 172.21.15.129:0/1025791008 shutdown_connections 2020-01-26T15:24:37.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.710+0000 7fc77f59e700 1 -- 172.21.15.129:0/1025791008 wait complete. 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 Processor -- start 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- start start 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7800a39d0 con 0x7fc780065be0 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78009e150 con 0x7fc780139400 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc780121280 con 0x7fc7800657b0 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc784903700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fc780139400 0x7fc78013b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48346/0 (socket says 172.21.15.129:48346) 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc784903700 1 -- 172.21.15.129:0/920991102 learned_addr learned my addr 172.21.15.129:0/920991102 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452745903 0 0) 0x7fc780121280 con 0x7fc7800657b0 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc764003230 con 0x7fc7800657b0 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154894455 0 0) 0x7fc7800a39d0 con 0x7fc780065be0 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc780121280 con 0x7fc780065be0 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534387570 0 0) 0x7fc78009e150 con 0x7fc780139400 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7800a39d0 con 0x7fc780139400 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 741948672 0 0) 0x7fc764003230 con 0x7fc7800657b0 2020-01-26T15:24:37.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc78009e150 con 0x7fc7800657b0 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc7700019a0 con 0x7fc7800657b0 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 347072630 0 0) 0x7fc780121280 con 0x7fc780065be0 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc764003230 con 0x7fc780065be0 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc768001b20 con 0x7fc780065be0 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6791/0 conn(0x7fc7800657b0 legacy=0x7fc78007d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6790/0 conn(0x7fc780139400 legacy=0x7fc78013b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6789/0 conn(0x7fc780065be0 legacy=0x7fc78007e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:37.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc764003230 con 0x7fc764004f50 2020-01-26T15:24:37.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:37.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc7800a39d0 con 0x7fc764004af0 2020-01-26T15:24:37.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640107a0 con 0x7fc764004090 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6791/0 conn(0x7fc764004af0 legacy=0x7fc764009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681074961 0 0) 0x7fc7800a39d0 con 0x7fc764004af0 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6790/0 conn(0x7fc764004f50 legacy=0x7fc76400cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fc7800a3dd0 con 0x7fc764004090 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7800657b0 con 0x7fc764004090 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78007d9f0 con 0x7fc764004090 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.714+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc77000e160 con 0x7fc764004090 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000e360 con 0x7fc764004090 2020-01-26T15:24:37.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758003360 con 0x7fc764004090 2020-01-26T15:24:37.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc77000e550 con 0x7fc764004090 2020-01-26T15:24:37.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.718+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7fc77004dda0 con 0x7fc764004090 2020-01-26T15:24:37.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.722+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.722+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc770033f10 con 0x7fc764004090 2020-01-26T15:24:37.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7580021f0 con 0x7fc764004090 2020-01-26T15:24:37.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77ed9d700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc7777fe700 1 -- 172.21.15.129:0/920991102 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc770034170 con 0x7fc764004090 2020-01-26T15:24:37.844 INFO:teuthology.orchestra.run.smithi129.stdout:107374182405 2020-01-26T15:24:37.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 >> v1:172.21.15.129:6800/16899 conn(0x7fc764048240 legacy=0x7fc76404a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 msgr2=0x7fc7640045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 --2- 172.21.15.129:0/920991102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc764004090 0x7fc7640045a0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fc7700017b0 tx=0x7fc770011780).stop 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc784903700 1 -- 172.21.15.129:0/920991102 reap_dead start 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 shutdown_connections 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 >> 172.21.15.129:0/920991102 conn(0x7fc78005e5f0 msgr2=0x7fc7800a41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 shutdown_connections 2020-01-26T15:24:37.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.842+0000 7fc77f59e700 1 -- 172.21.15.129:0/920991102 wait complete. 2020-01-26T15:24:37.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182404 got 107374182405 for osd.2 2020-01-26T15:24:37.857 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-01-26T15:24:37.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 Processor -- start 2020-01-26T15:24:37.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 -- start start 2020-01-26T15:24:37.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f199c05edd0 0x7f199c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c098000 con 0x7f199c0a6870 2020-01-26T15:24:37.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c05e050 con 0x7f199c149040 2020-01-26T15:24:37.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a0857700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0a6ca0 con 0x7f199c05edd0 2020-01-26T15:24:37.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f199b59e700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f199c05edd0 0x7f199c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a1058700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f199c149040 0x7f199c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48358/0 (socket says 172.21.15.129:48358) 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f199b59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f199c05edd0 0x7f199c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.966+0000 7f19a1058700 1 -- 172.21.15.129:0/3120856236 learned_addr learned my addr 172.21.15.129:0/3120856236 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616881658 0 0) 0x7f199c098000 con 0x7f199c0a6870 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1984003230 con 0x7f199c0a6870 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165768772 0 0) 0x7f199c05e050 con 0x7f199c149040 2020-01-26T15:24:37.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c098000 con 0x7f199c149040 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3631590269 0 0) 0x7f1984003230 con 0x7f199c0a6870 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 >> v2:172.21.15.129:6790/0 conn(0x7f199c05edd0 msgr2=0x7f199c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 --2- 172.21.15.129:0/3120856236 >> v2:172.21.15.129:6790/0 conn(0x7f199c05edd0 0x7f199c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 >> v1:172.21.15.129:6790/0 conn(0x7f199c149040 legacy=0x7f199c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c14ecb0 con 0x7f199c0a6870 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1990001710 con 0x7f199c0a6870 2020-01-26T15:24:37.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 >> v1:172.21.15.129:6789/0 conn(0x7f199c0a6870 legacy=0x7f199c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1984003230 con 0x7f1984004ff0 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f199c05e050 con 0x7f1984004b20 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0a6ca0 con 0x7f198400b800 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306451951 0 0) 0x7f1984003230 con 0x7f1984004ff0 2020-01-26T15:24:37.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198400f300 con 0x7f1984004ff0 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614923917 0 0) 0x7f199c05e050 con 0x7f1984004b20 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1984003230 con 0x7f1984004b20 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1565194399 0 0) 0x7f1984003230 con 0x7f1984004b20 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 -- 172.21.15.129:0/3120856236 >> v1:172.21.15.129:6791/0 conn(0x7f1984004b20 legacy=0x7f1984003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 -- 172.21.15.129:0/3120856236 >> v1:172.21.15.129:6790/0 conn(0x7f1984004ff0 legacy=0x7f1984003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 -- 172.21.15.129:0/3120856236 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984054540 con 0x7f198400b800 2020-01-26T15:24:37.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1990002cb0 tx=0x7f1990002d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1990002cb0 tx=0x7f1990002d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1990002cb0 tx=0x7f1990002d30).ready entity=mon.0 client_cookie=f4efeb4592c4f08 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1990002cb0 tx=0x7f1990002d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1990001c20 con 0x7f198400b800 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1990002cb0 tx=0x7f1990002d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1990002cb0 tx=0x7f1990002d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990002ac0 con 0x7f198400b800 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f199a59c700 1 -- 172.21.15.129:0/3120856236 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f198c001400 con 0x7f198400b800 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 -- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 msgr2=0x7f198400dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 --2- 172.21.15.129:0/3120856236 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f198400b800 0x7f198400dc40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1990002cb0 tx=0x7f1990002d30).stop 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a1058700 1 -- 172.21.15.129:0/3120856236 reap_dead start 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 -- 172.21.15.129:0/3120856236 shutdown_connections 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 -- 172.21.15.129:0/3120856236 >> 172.21.15.129:0/3120856236 conn(0x7f199c098e70 msgr2=0x7f199c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:37.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 -- 172.21.15.129:0/3120856236 shutdown_connections 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.970+0000 7f19a0857700 1 -- 172.21.15.129:0/3120856236 wait complete. 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 Processor -- start 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 -- start start 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f199c09ef10 0x7f199c09e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0a1970 con 0x7f199c07ea00 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c11fcd0 con 0x7f199c0a0bb0 2020-01-26T15:24:37.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a0857700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0a13a0 con 0x7f199c09ef10 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f199b59e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f199c09ef10 0x7f199c09e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f199b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f199c09ef10 0x7f199c09e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f199ad9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f199c0a0bb0 0x7f199c09fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:45986/0 (socket says 172.21.15.129:45986) 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f199ad9d700 1 -- 172.21.15.129:0/1368963926 learned_addr learned my addr 172.21.15.129:0/1368963926 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.974+0000 7f19a1058700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f199c07ea00 0x7f199c07ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40072/0 (socket says 172.21.15.129:40072) 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780373273 0 0) 0x7f199c0a1970 con 0x7f199c07ea00 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f197c003230 con 0x7f199c07ea00 2020-01-26T15:24:37.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191561934 0 0) 0x7f199c11fcd0 con 0x7f199c0a0bb0 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0a1970 con 0x7f199c0a0bb0 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4045978906 0 0) 0x7f197c003230 con 0x7f199c07ea00 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f199c11fcd0 con 0x7f199c07ea00 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f199400bc60 con 0x7f199c07ea00 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 >> v2:172.21.15.129:6791/0 conn(0x7f199c09ef10 msgr2=0x7f199c09e090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 --2- 172.21.15.129:0/1368963926 >> v2:172.21.15.129:6791/0 conn(0x7f199c09ef10 0x7f199c09e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:37.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 >> v1:172.21.15.129:6791/0 conn(0x7f199c0a0bb0 legacy=0x7f199c09fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 >> v1:172.21.15.129:6789/0 conn(0x7f199c07ea00 legacy=0x7f199c07ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f199c0a1970 con 0x7f197c00a7f0 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f197c003230 con 0x7f197c004c20 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c010460 con 0x7f197c005050 2020-01-26T15:24:37.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:37.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082456336 0 0) 0x7f197c003230 con 0x7f197c004c20 2020-01-26T15:24:37.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f197c00e440 con 0x7f197c004c20 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974469248 0 0) 0x7f199c0a1970 con 0x7f197c00a7f0 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 -- 172.21.15.129:0/1368963926 >> v1:172.21.15.129:6791/0 conn(0x7f197c004c20 legacy=0x7f197c003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 -- 172.21.15.129:0/1368963926 >> v1:172.21.15.129:6790/0 conn(0x7f197c00a7f0 legacy=0x7f197c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c07f630 con 0x7f197c005050 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0a0bb0 con 0x7f197c005050 2020-01-26T15:24:37.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c09fcb0 con 0x7f197c005050 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f199000d710 con 0x7f197c005050 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.995 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000d910 con 0x7f197c005050 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f199000dcb0 con 0x7f197c005050 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.978+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974003360 con 0x7f197c005050 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.982+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1990007470 con 0x7f197c005050 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.982+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.996 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.982+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f1990012dc0 con 0x7f197c005050 2020-01-26T15:24:37.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.986+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:37.997 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:37.986+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1990033f30 con 0x7f197c005050 2020-01-26T15:24:38.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19740021f0 con 0x7f197c005050 2020-01-26T15:24:38.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f199ad9d700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f1983fff700 1 -- 172.21.15.129:0/1368963926 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1990034190 con 0x7f197c005050 2020-01-26T15:24:38.104 INFO:teuthology.orchestra.run.smithi129.stdout:103079215109 2020-01-26T15:24:38.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 >> v1:172.21.15.129:6800/16899 conn(0x7f197c048340 legacy=0x7f197c04a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 msgr2=0x7f197c003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 --2- 172.21.15.129:0/1368963926 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f197c005050 0x7f197c003d40 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1990002b00 tx=0x7f19900117e0).stop 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a1058700 1 -- 172.21.15.129:0/1368963926 reap_dead start 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a1058700 1 -- 172.21.15.129:0/1368963926 reap_dead start 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 shutdown_connections 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 >> 172.21.15.129:0/1368963926 conn(0x7f199c098e10 msgr2=0x7f199c1224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 shutdown_connections 2020-01-26T15:24:38.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.102+0000 7f19a0857700 1 -- 172.21.15.129:0/1368963926 wait complete. 2020-01-26T15:24:38.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215109 for osd.3 2020-01-26T15:24:38.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-01-26T15:24:38.121 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.222+0000 7f088b59e700 1 Processor -- start 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.222+0000 7f088b59e700 1 -- start start 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 0x7f088c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c098000 con 0x7f088c0a6870 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c05e050 con 0x7f088c149040 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0a6ca0 con 0x7f088c05edd0 2020-01-26T15:24:38.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088ad9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 0x7f088c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088ad9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 0x7f088c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088a59c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f088c0a6870 0x7f088c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40082/0 (socket says 172.21.15.129:40082) 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088a59c700 1 -- 172.21.15.129:0/1808011281 learned_addr learned my addr 172.21.15.129:0/1808011281 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0890b39700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f088c149040 0x7f088c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46002/0 (socket says 172.21.15.129:46002) 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840881356 0 0) 0x7f088c098000 con 0x7f088c0a6870 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f086c003230 con 0x7f088c0a6870 2020-01-26T15:24:38.232 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140555358 0 0) 0x7f088c05e050 con 0x7f088c149040 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c098000 con 0x7f088c149040 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4172171550 0 0) 0x7f088c098000 con 0x7f088c149040 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 msgr2=0x7f088c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 --2- 172.21.15.129:0/1808011281 >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 0x7f088c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 >> v1:172.21.15.129:6789/0 conn(0x7f088c0a6870 legacy=0x7f088c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c14ecb0 con 0x7f088c149040 2020-01-26T15:24:38.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f08840019a0 con 0x7f088c149040 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0884001c70 con 0x7f088c149040 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f0889d9b700 1 -- 172.21.15.129:0/1808011281 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0884004870 con 0x7f088c149040 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- 172.21.15.129:0/1808011281 >> v1:172.21.15.129:6791/0 conn(0x7f088c149040 legacy=0x7f088c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- 172.21.15.129:0/1808011281 shutdown_connections 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 --2- 172.21.15.129:0/1808011281 >> v2:172.21.15.129:6790/0 conn(0x7f088c05edd0 0x7f088c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- 172.21.15.129:0/1808011281 >> 172.21.15.129:0/1808011281 conn(0x7f088c098e70 msgr2=0x7f088c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- 172.21.15.129:0/1808011281 shutdown_connections 2020-01-26T15:24:38.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.226+0000 7f088b59e700 1 -- 172.21.15.129:0/1808011281 wait complete. 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 Processor -- start 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 -- start start 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f088c137950 0x7f088c139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c121d40 con 0x7f088c077990 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c11fd70 con 0x7f088c120a40 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088b59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0a1a90 con 0x7f088c137950 2020-01-26T15:24:38.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f0890b39700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f088c137950 0x7f088c139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088a59c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f088c077990 0x7f088c077dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40088/0 (socket says 172.21.15.129:40088) 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f0890b39700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f088c137950 0x7f088c139d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f088a59c700 1 -- 172.21.15.129:0/3012285810 learned_addr learned my addr 172.21.15.129:0/3012285810 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498691785 0 0) 0x7f088c121d40 con 0x7f088c077990 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864003230 con 0x7f088c077990 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638938315 0 0) 0x7f088c11fd70 con 0x7f088c120a40 2020-01-26T15:24:38.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f088c121d40 con 0x7f088c120a40 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1014058922 0 0) 0x7f088c121d40 con 0x7f088c120a40 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f088c11fd70 con 0x7f088c120a40 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f08740016a0 con 0x7f088c120a40 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4134397631 0 0) 0x7f0864003230 con 0x7f088c077990 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f088c121d40 con 0x7f088c077990 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f087c001850 con 0x7f088c077990 2020-01-26T15:24:38.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 >> v2:172.21.15.129:6791/0 conn(0x7f088c137950 msgr2=0x7f088c139d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 --2- 172.21.15.129:0/3012285810 >> v2:172.21.15.129:6791/0 conn(0x7f088c137950 0x7f088c139d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 >> v1:172.21.15.129:6790/0 conn(0x7f088c120a40 legacy=0x7f088c078bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 >> v1:172.21.15.129:6789/0 conn(0x7f088c077990 legacy=0x7f088c077dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0864003230 con 0x7f0864004f20 2020-01-26T15:24:38.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0864004260 con 0x7f0864003d40 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0a1a90 con 0x7f086400c000 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.230+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096560662 0 0) 0x7f0864003230 con 0x7f0864004f20 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 -- 172.21.15.129:0/3012285810 >> v1:172.21.15.129:6791/0 conn(0x7f0864003d40 legacy=0x7f086400a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 -- 172.21.15.129:0/3012285810 >> v1:172.21.15.129:6790/0 conn(0x7f0864004f20 legacy=0x7f0864003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 -- 172.21.15.129:0/3012285810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f088c11ec30 con 0x7f086400c000 2020-01-26T15:24:38.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c0a11c0 con 0x7f086400c000 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c11dfc0 con 0x7f086400c000 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0884007180 con 0x7f086400c000 2020-01-26T15:24:38.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08840014c0 con 0x7f086400c000 2020-01-26T15:24:38.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868003360 con 0x7f086400c000 2020-01-26T15:24:38.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f0884007380 con 0x7f086400c000 2020-01-26T15:24:38.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.234+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f088404ccb0 con 0x7f086400c000 2020-01-26T15:24:38.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.242+0000 7f0890b39700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.242+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f0884032e20 con 0x7f086400c000 2020-01-26T15:24:38.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.362+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 --> v1:172.21.15.129:6800/16899 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08680021c0 con 0x7f08640484d0 2020-01-26T15:24:38.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f08837fe700 1 -- 172.21.15.129:0/3012285810 <== mgr.44103 v1:172.21.15.129:6800/16899 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63475 (unknown 2965378022 0 3928613246) 0x7f08680021c0 con 0x7f08640484d0 2020-01-26T15:24:38.370 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 >> v1:172.21.15.129:6800/16899 conn(0x7f08640484d0 legacy=0x7f086404a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 msgr2=0x7f086400e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f0890b39700 1 -- 172.21.15.129:0/3012285810 reap_dead start 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7f087c001620 tx=0x7f0884010ca0).stop 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 shutdown_connections 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 --2- 172.21.15.129:0/3012285810 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f086400c000 0x7f086400e440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 >> 172.21.15.129:0/3012285810 conn(0x7f088c05bf50 msgr2=0x7f088c0a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 shutdown_connections 2020-01-26T15:24:38.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.366+0000 7f088b59e700 1 -- 172.21.15.129:0/3012285810 wait complete. 2020-01-26T15:24:38.372 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:24:38.383 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-01-26T15:24:36.638869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4198944,"kb_used_data":4576,"kb_used_omap":7,"kb_used_meta":4194296,"kb_avail":373288416,"statfs":{"total":386547056640,"available":382247337984,"internally_reserved":4294967296,"allocated":4685824,"data_stored":393516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7928,"internal_metadata":4294959368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,6],"upper_bound":16384},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.420646"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242995+0000","last_change":"2020-01-26T15:24:22.468124+0000","last_active":"2020-01-26T15:24:33.242995+0000","last_peered":"2020-01-26T15:24:33.242995+0000","last_clean":"2020-01-26T15:24:33.242995+0000","last_became_active":"2020-01-26T15:24:22.467727+0000","last_became_peered":"2020-01-26T15:24:22.467727+0000","last_unstale":"2020-01-26T15:24:33.242995+0000","last_undegraded":"2020-01-26T15:24:33.242995+0000","last_fullsized":"2020-01-26T15:24:33.242995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384070+0000","last_change":"2020-01-26T15:24:23.468445+0000","last_active":"2020-01-26T15:24:33.384070+0000","last_peered":"2020-01-26T15:24:33.384070+0000","last_clean":"2020-01-26T15:24:33.384070+0000","last_became_active":"2020-01-26T15:24:23.468003+0000","last_became_peered":"2020-01-26T15:24:23.468003+0000","last_unstale":"2020-01-26T15:24:33.384070+0000","last_undegraded":"2020-01-26T15:24:33.384070+0000","last_fullsized":"2020-01-26T15:24:33.384070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'5","reported_seq":"42","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.245425+0000","last_change":"2020-01-26T15:24:29.223979+0000","last_active":"2020-01-26T15:24:33.245425+0000","last_peered":"2020-01-26T15:24:33.245425+0000","last_clean":"2020-01-26T15:24:33.245425+0000","last_became_active":"2020-01-26T15:24:21.459309+0000","last_became_peered":"2020-01-26T15:24:21.459309+0000","last_unstale":"2020-01-26T15:24:33.245425+0000","last_undegraded":"2020-01-26T15:24:33.245425+0000","last_fullsized":"2020-01-26T15:24:33.245425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.384022+0000","last_change":"2020-01-26T15:24:21.460844+0000","last_active":"2020-01-26T15:24:33.384022+0000","last_peered":"2020-01-26T15:24:33.384022+0000","last_clean":"2020-01-26T15:24:33.384022+0000","last_became_active":"2020-01-26T15:24:21.460490+0000","last_became_peered":"2020-01-26T15:24:21.460490+0000","last_unstale":"2020-01-26T15:24:33.384022+0000","last_undegraded":"2020-01-26T15:24:33.384022+0000","last_fullsized":"2020-01-26T15:24:33.384022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242227+0000","last_change":"2020-01-26T15:24:22.464304+0000","last_active":"2020-01-26T15:24:33.242227+0000","last_peered":"2020-01-26T15:24:33.242227+0000","last_clean":"2020-01-26T15:24:33.242227+0000","last_became_active":"2020-01-26T15:24:22.463896+0000","last_became_peered":"2020-01-26T15:24:22.463896+0000","last_unstale":"2020-01-26T15:24:33.242227+0000","last_undegraded":"2020-01-26T15:24:33.242227+0000","last_fullsized":"2020-01-26T15:24:33.242227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"40","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.243553+0000","last_change":"2020-01-26T15:24:29.226496+0000","last_active":"2020-01-26T15:24:33.243553+0000","last_peered":"2020-01-26T15:24:33.243553+0000","last_clean":"2020-01-26T15:24:33.243553+0000","last_became_active":"2020-01-26T15:24:22.469185+0000","last_became_peered":"2020-01-26T15:24:22.469185+0000","last_unstale":"2020-01-26T15:24:33.243553+0000","last_undegraded":"2020-01-26T15:24:33.243553+0000","last_fullsized":"2020-01-26T15:24:33.243553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.383817+0000","last_change":"2020-01-26T15:24:23.465630+0000","last_active":"2020-01-26T15:24:33.383817+0000","last_peered":"2020-01-26T15:24:33.383817+0000","last_clean":"2020-01-26T15:24:33.383817+0000","last_became_active":"2020-01-26T15:24:23.464992+0000","last_became_peered":"2020-01-26T15:24:23.464992+0000","last_unstale":"2020-01-26T15:24:33.383817+0000","last_undegraded":"2020-01-26T15:24:33.383817+0000","last_fullsized":"2020-01-26T15:24:33.383817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245186+0000","last_change":"2020-01-26T15:24:23.466427+0000","last_active":"2020-01-26T15:24:33.245186+0000","last_peered":"2020-01-26T15:24:33.245186+0000","last_clean":"2020-01-26T15:24:33.245186+0000","last_became_active":"2020-01-26T15:24:23.465833+0000","last_became_peered":"2020-01-26T15:24:23.465833+0000","last_unstale":"2020-01-26T15:24:33.245186+0000","last_undegraded":"2020-01-26T15:24:33.245186+0000","last_fullsized":"2020-01-26T15:24:33.245186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"43","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241618+0000","last_change":"2020-01-26T15:24:22.468501+0000","last_active":"2020-01-26T15:24:33.241618+0000","last_peered":"2020-01-26T15:24:33.241618+0000","last_clean":"2020-01-26T15:24:33.241618+0000","last_became_active":"2020-01-26T15:24:22.468081+0000","last_became_peered":"2020-01-26T15:24:22.468081+0000","last_unstale":"2020-01-26T15:24:33.241618+0000","last_undegraded":"2020-01-26T15:24:33.241618+0000","last_fullsized":"2020-01-26T15:24:33.241618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245612+0000","last_change":"2020-01-26T15:24:23.464660+0000","last_active":"2020-01-26T15:24:33.245612+0000","last_peered":"2020-01-26T15:24:33.245612+0000","last_clean":"2020-01-26T15:24:33.245612+0000","last_became_active":"2020-01-26T15:24:23.464220+0000","last_became_peered":"2020-01-26T15:24:23.464220+0000","last_unstale":"2020-01-26T15:24:33.245612+0000","last_undegraded":"2020-01-26T15:24:33.245612+0000","last_fullsized":"2020-01-26T15:24:33.245612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.383716+0000","last_change":"2020-01-26T15:24:21.457953+0000","last_active":"2020-01-26T15:24:33.383716+0000","last_peered":"2020-01-26T15:24:33.383716+0000","last_clean":"2020-01-26T15:24:33.383716+0000","last_became_active":"2020-01-26T15:24:21.457575+0000","last_became_peered":"2020-01-26T15:24:21.457575+0000","last_unstale":"2020-01-26T15:24:33.383716+0000","last_undegraded":"2020-01-26T15:24:33.383716+0000","last_fullsized":"2020-01-26T15:24:33.383716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384202+0000","last_change":"2020-01-26T15:24:23.467470+0000","last_active":"2020-01-26T15:24:33.384202+0000","last_peered":"2020-01-26T15:24:33.384202+0000","last_clean":"2020-01-26T15:24:33.384202+0000","last_became_active":"2020-01-26T15:24:23.467179+0000","last_became_peered":"2020-01-26T15:24:23.467179+0000","last_unstale":"2020-01-26T15:24:33.384202+0000","last_undegraded":"2020-01-26T15:24:33.384202+0000","last_fullsized":"2020-01-26T15:24:33.384202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242279+0000","last_change":"2020-01-26T15:24:23.467577+0000","last_active":"2020-01-26T15:24:33.242279+0000","last_peered":"2020-01-26T15:24:33.242279+0000","last_clean":"2020-01-26T15:24:33.242279+0000","last_became_active":"2020-01-26T15:24:23.467251+0000","last_became_peered":"2020-01-26T15:24:23.467251+0000","last_unstale":"2020-01-26T15:24:33.242279+0000","last_undegraded":"2020-01-26T15:24:33.242279+0000","last_fullsized":"2020-01-26T15:24:33.242279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245123+0000","last_change":"2020-01-26T15:24:21.457984+0000","last_active":"2020-01-26T15:24:33.245123+0000","last_peered":"2020-01-26T15:24:33.245123+0000","last_clean":"2020-01-26T15:24:33.245123+0000","last_became_active":"2020-01-26T15:24:21.457642+0000","last_became_peered":"2020-01-26T15:24:21.457642+0000","last_unstale":"2020-01-26T15:24:33.245123+0000","last_undegraded":"2020-01-26T15:24:33.245123+0000","last_fullsized":"2020-01-26T15:24:33.245123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"30","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.242125+0000","last_change":"2020-01-26T15:24:29.226180+0000","last_active":"2020-01-26T15:24:33.242125+0000","last_peered":"2020-01-26T15:24:33.242125+0000","last_clean":"2020-01-26T15:24:33.242125+0000","last_became_active":"2020-01-26T15:24:23.468441+0000","last_became_peered":"2020-01-26T15:24:23.468441+0000","last_unstale":"2020-01-26T15:24:33.242125+0000","last_undegraded":"2020-01-26T15:24:33.242125+0000","last_fullsized":"2020-01-26T15:24:33.242125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.383640+0000","last_change":"2020-01-26T15:24:23.466545+0000","last_active":"2020-01-26T15:24:33.383640+0000","last_peered":"2020-01-26T15:24:33.383640+0000","last_clean":"2020-01-26T15:24:33.383640+0000","last_became_active":"2020-01-26T15:24:23.466101+0000","last_became_peered":"2020-01-26T15:24:23.466101+0000","last_unstale":"2020-01-26T15:24:33.383640+0000","last_undegraded":"2020-01-26T15:24:33.383640+0000","last_fullsized":"2020-01-26T15:24:33.383640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241806+0000","last_change":"2020-01-26T15:24:22.468078+0000","last_active":"2020-01-26T15:24:33.241806+0000","last_peered":"2020-01-26T15:24:33.241806+0000","last_clean":"2020-01-26T15:24:33.241806+0000","last_became_active":"2020-01-26T15:24:22.467411+0000","last_became_peered":"2020-01-26T15:24:22.467411+0000","last_unstale":"2020-01-26T15:24:33.241806+0000","last_undegraded":"2020-01-26T15:24:33.241806+0000","last_fullsized":"2020-01-26T15:24:33.241806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"36","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241840+0000","last_change":"2020-01-26T15:24:22.466514+0000","last_active":"2020-01-26T15:24:33.241840+0000","last_peered":"2020-01-26T15:24:33.241840+0000","last_clean":"2020-01-26T15:24:33.241840+0000","last_became_active":"2020-01-26T15:24:22.466078+0000","last_became_peered":"2020-01-26T15:24:22.466078+0000","last_unstale":"2020-01-26T15:24:33.241840+0000","last_undegraded":"2020-01-26T15:24:33.241840+0000","last_fullsized":"2020-01-26T15:24:33.241840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245444+0000","last_change":"2020-01-26T15:24:23.464681+0000","last_active":"2020-01-26T15:24:33.245444+0000","last_peered":"2020-01-26T15:24:33.245444+0000","last_clean":"2020-01-26T15:24:33.245444+0000","last_became_active":"2020-01-26T15:24:23.464296+0000","last_became_peered":"2020-01-26T15:24:23.464296+0000","last_unstale":"2020-01-26T15:24:33.245444+0000","last_undegraded":"2020-01-26T15:24:33.245444+0000","last_fullsized":"2020-01-26T15:24:33.245444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242334+0000","last_change":"2020-01-26T15:24:22.464454+0000","last_active":"2020-01-26T15:24:33.242334+0000","last_peered":"2020-01-26T15:24:33.242334+0000","last_clean":"2020-01-26T15:24:33.242334+0000","last_became_active":"2020-01-26T15:24:22.464010+0000","last_became_peered":"2020-01-26T15:24:22.464010+0000","last_unstale":"2020-01-26T15:24:33.242334+0000","last_undegraded":"2020-01-26T15:24:33.242334+0000","last_fullsized":"2020-01-26T15:24:33.242334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"39","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.242620+0000","last_change":"2020-01-26T15:24:29.226369+0000","last_active":"2020-01-26T15:24:33.242620+0000","last_peered":"2020-01-26T15:24:33.242620+0000","last_clean":"2020-01-26T15:24:33.242620+0000","last_became_active":"2020-01-26T15:24:22.466385+0000","last_became_peered":"2020-01-26T15:24:22.466385+0000","last_unstale":"2020-01-26T15:24:33.242620+0000","last_undegraded":"2020-01-26T15:24:33.242620+0000","last_fullsized":"2020-01-26T15:24:33.242620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384234+0000","last_change":"2020-01-26T15:24:23.468385+0000","last_active":"2020-01-26T15:24:33.384234+0000","last_peered":"2020-01-26T15:24:33.384234+0000","last_clean":"2020-01-26T15:24:33.384234+0000","last_became_active":"2020-01-26T15:24:23.467925+0000","last_became_peered":"2020-01-26T15:24:23.467925+0000","last_unstale":"2020-01-26T15:24:33.384234+0000","last_undegraded":"2020-01-26T15:24:33.384234+0000","last_fullsized":"2020-01-26T15:24:33.384234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245347+0000","last_change":"2020-01-26T15:24:22.471996+0000","last_active":"2020-01-26T15:24:33.245347+0000","last_peered":"2020-01-26T15:24:33.245347+0000","last_clean":"2020-01-26T15:24:33.245347+0000","last_became_active":"2020-01-26T15:24:22.471594+0000","last_became_peered":"2020-01-26T15:24:22.471594+0000","last_unstale":"2020-01-26T15:24:33.245347+0000","last_undegraded":"2020-01-26T15:24:33.245347+0000","last_fullsized":"2020-01-26T15:24:33.245347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'14","reported_seq":"49","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245236+0000","last_change":"2020-01-26T15:24:21.456458+0000","last_active":"2020-01-26T15:24:33.245236+0000","last_peered":"2020-01-26T15:24:33.245236+0000","last_clean":"2020-01-26T15:24:33.245236+0000","last_became_active":"2020-01-26T15:24:21.456052+0000","last_became_peered":"2020-01-26T15:24:21.456052+0000","last_unstale":"2020-01-26T15:24:33.245236+0000","last_undegraded":"2020-01-26T15:24:33.245236+0000","last_fullsized":"2020-01-26T15:24:33.245236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":10432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049760,"kb_used_data":1168,"kb_used_omap":3,"kb_used_meta":1048572,"kb_avail":93322080,"statfs":{"total":96636764160,"available":95561809920,"internally_reserved":1073741824,"allocated":1196032,"data_stored":97494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3772,"internal_metadata":1073738052},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182405,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049696,"kb_used_data":1104,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93322144,"statfs":{"total":96636764160,"available":95561875456,"internally_reserved":1073741824,"allocated":1130496,"data_stored":96768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4156,"internal_metadata":1073737668},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049760,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322080,"statfs":{"total":96636764160,"available":95561809920,"internally_reserved":1073741824,"allocated":1196032,"data_stored":98064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049728,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322112,"statfs":{"total":96636764160,"available":95561842688,"internally_reserved":1073741824,"allocated":1163264,"data_stored":101190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":16384},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:24:38.386 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-01-26T15:24:38.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.494+0000 7fe6f5376700 1 Processor -- start 2020-01-26T15:24:38.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f5376700 1 -- start start 2020-01-26T15:24:38.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f5376700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fe6f005e5f0 0x7fe6f00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:38.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f5376700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00a6dc0 con 0x7fe6f005edd0 2020-01-26T15:24:38.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f5376700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f005ea20 con 0x7fe6f0149040 2020-01-26T15:24:38.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f5376700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f0098000 con 0x7fe6f005e5f0 2020-01-26T15:24:38.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f4b75700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fe6f005edd0 0x7fe6f007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40104/0 (socket says 172.21.15.129:40104) 2020-01-26T15:24:38.510 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f4b75700 1 -- 172.21.15.129:0/2988006028 learned_addr learned my addr 172.21.15.129:0/2988006028 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e7fff700 -1 --2- 172.21.15.129:0/2988006028 >> v2:172.21.15.129:6791/0 conn(0x7fe6f005e5f0 0x7fe6f00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:38.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e7fff700 1 --2- 172.21.15.129:0/2988006028 >> v2:172.21.15.129:6791/0 conn(0x7fe6f005e5f0 0x7fe6f00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.511 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855382171 0 0) 0x7fe6f00a6dc0 con 0x7fe6f005edd0 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8003230 con 0x7fe6f005edd0 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202635957 0 0) 0x7fe6f005ea20 con 0x7fe6f0149040 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f00a6dc0 con 0x7fe6f0149040 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2839417204 0 0) 0x7fe6d8003230 con 0x7fe6f005edd0 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 >> v2:172.21.15.129:6791/0 conn(0x7fe6f005e5f0 msgr2=0x7fe6f00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 --2- 172.21.15.129:0/2988006028 >> v2:172.21.15.129:6791/0 conn(0x7fe6f005e5f0 0x7fe6f00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:38.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 >> v1:172.21.15.129:6791/0 conn(0x7fe6f0149040 legacy=0x7fe6f014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f005e050 con 0x7fe6f005edd0 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe6ec001710 con 0x7fe6f005edd0 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 >> v1:172.21.15.129:6789/0 conn(0x7fe6f005edd0 legacy=0x7fe6f007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6d8003230 con 0x7fe6d80045a0 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe6f005ea20 con 0x7fe6d800a7f0 2020-01-26T15:24:38.513 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0098000 con 0x7fe6d8003ac0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124208027 0 0) 0x7fe6f005ea20 con 0x7fe6d800a7f0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d800e440 con 0x7fe6d800a7f0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244541515 0 0) 0x7fe6d8003230 con 0x7fe6d80045a0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f005ea20 con 0x7fe6d80045a0 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f4b75700 1 -- 172.21.15.129:0/2988006028 >> v1:172.21.15.129:6791/0 conn(0x7fe6d800a7f0 legacy=0x7fe6d800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.498+0000 7fe6f4b75700 1 -- 172.21.15.129:0/2988006028 >> v1:172.21.15.129:6790/0 conn(0x7fe6d80045a0 legacy=0x7fe6d80049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 -- 172.21.15.129:0/2988006028 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8054530 con 0x7fe6d8003ac0 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).ready entity=mon.0 client_cookie=583ba95f88ec3535 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe6ec010160 con 0x7fe6d8003ac0 2020-01-26T15:24:38.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f4b75700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec010360 con 0x7fe6d8003ac0 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6e77fe700 1 -- 172.21.15.129:0/2988006028 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe6ec010700 con 0x7fe6d8003ac0 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 -- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 msgr2=0x7fe6d8003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 --2- 172.21.15.129:0/2988006028 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe6d8003ac0 0x7fe6d8003f10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fe6ec001520 tx=0x7fe6ec00c1f0).stop 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f65d8700 1 -- 172.21.15.129:0/2988006028 reap_dead start 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 -- 172.21.15.129:0/2988006028 shutdown_connections 2020-01-26T15:24:38.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 -- 172.21.15.129:0/2988006028 >> 172.21.15.129:0/2988006028 conn(0x7fe6f0098e70 msgr2=0x7fe6f00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 -- 172.21.15.129:0/2988006028 shutdown_connections 2020-01-26T15:24:38.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.502+0000 7fe6f5376700 1 -- 172.21.15.129:0/2988006028 wait complete. 2020-01-26T15:24:38.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 Processor -- start 2020-01-26T15:24:38.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- start start 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 0x7fe6f009c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f01333a0 con 0x7fe6f009bac0 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0066030 con 0x7fe6f009b690 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00251c0 con 0x7fe6f012d8b0 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f4b75700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fe6f009b690 0x7fe6f012d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46032/0 (socket says 172.21.15.129:46032) 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f4b75700 1 -- 172.21.15.129:0/4142854515 learned_addr learned my addr 172.21.15.129:0/4142854515 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e7fff700 -1 --2- 172.21.15.129:0/4142854515 >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 0x7fe6f009c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e7fff700 1 --2- 172.21.15.129:0/4142854515 >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 0x7fe6f009c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505566328 0 0) 0x7fe6f0066030 con 0x7fe6f009b690 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d0003230 con 0x7fe6f009b690 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276388995 0 0) 0x7fe6f01333a0 con 0x7fe6f009bac0 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0066030 con 0x7fe6f009bac0 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3948893077 0 0) 0x7fe6d0003230 con 0x7fe6f009b690 2020-01-26T15:24:38.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6f01333a0 con 0x7fe6f009b690 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe6ec001560 con 0x7fe6f009b690 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 351699238 0 0) 0x7fe6f0066030 con 0x7fe6f009bac0 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe6d0003230 con 0x7fe6f009bac0 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe6e8001dc0 con 0x7fe6f009bac0 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3735860440 0 0) 0x7fe6d0003230 con 0x7fe6f009bac0 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 msgr2=0x7fe6f009c920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:38.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 --2- 172.21.15.129:0/4142854515 >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 0x7fe6f009c920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 >> v1:172.21.15.129:6791/0 conn(0x7fe6f009b690 legacy=0x7fe6f012d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0024af0 con 0x7fe6f009bac0 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f013b7a0 con 0x7fe6f009bac0 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f013bb50 con 0x7fe6f009bac0 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe6e8002330 con 0x7fe6f009bac0 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.506+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe6e8002750 con 0x7fe6f009bac0 2020-01-26T15:24:38.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.510+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fe6e8002950 con 0x7fe6f009bac0 2020-01-26T15:24:38.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.510+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f0056600 con 0x7fe6f009bac0 2020-01-26T15:24:38.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.510+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7fe6e804b870 con 0x7fe6f009bac0 2020-01-26T15:24:38.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.514+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fe6e8030b90 con 0x7fe6f009bac0 2020-01-26T15:24:38.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.626+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 --> v1:172.21.15.129:6800/16899 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6f005cc60 con 0x7fe6d003e3a0 2020-01-26T15:24:38.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6e57fa700 1 -- 172.21.15.129:0/4142854515 <== mgr.44103 v1:172.21.15.129:6800/16899 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+63475 (unknown 2965378022 0 3928613246) 0x7fe6f005cc60 con 0x7fe6d003e3a0 2020-01-26T15:24:38.637 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:38.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 >> v1:172.21.15.129:6800/16899 conn(0x7fe6d003e3a0 legacy=0x7fe6d00408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 >> v1:172.21.15.129:6790/0 conn(0x7fe6f009bac0 legacy=0x7fe6f009ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 shutdown_connections 2020-01-26T15:24:38.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 --2- 172.21.15.129:0/4142854515 >> v2:172.21.15.129:6791/0 conn(0x7fe6f012d8b0 0x7fe6f009c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 >> 172.21.15.129:0/4142854515 conn(0x7fe6f00a5520 msgr2=0x7fe6f00a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 shutdown_connections 2020-01-26T15:24:38.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.634+0000 7fe6f5376700 1 -- 172.21.15.129:0/4142854515 wait complete. 2020-01-26T15:24:38.639 INFO:teuthology.orchestra.run.smithi129.stderr:dumped all 2020-01-26T15:24:38.650 INFO:teuthology.orchestra.run.smithi129.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-01-26T15:24:36.638869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4198944,"kb_used_data":4576,"kb_used_omap":7,"kb_used_meta":4194296,"kb_avail":373288416,"statfs":{"total":386547056640,"available":382247337984,"internally_reserved":4294967296,"allocated":4685824,"data_stored":393516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7928,"internal_metadata":4294959368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,6],"upper_bound":16384},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.420646"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242995+0000","last_change":"2020-01-26T15:24:22.468124+0000","last_active":"2020-01-26T15:24:33.242995+0000","last_peered":"2020-01-26T15:24:33.242995+0000","last_clean":"2020-01-26T15:24:33.242995+0000","last_became_active":"2020-01-26T15:24:22.467727+0000","last_became_peered":"2020-01-26T15:24:22.467727+0000","last_unstale":"2020-01-26T15:24:33.242995+0000","last_undegraded":"2020-01-26T15:24:33.242995+0000","last_fullsized":"2020-01-26T15:24:33.242995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384070+0000","last_change":"2020-01-26T15:24:23.468445+0000","last_active":"2020-01-26T15:24:33.384070+0000","last_peered":"2020-01-26T15:24:33.384070+0000","last_clean":"2020-01-26T15:24:33.384070+0000","last_became_active":"2020-01-26T15:24:23.468003+0000","last_became_peered":"2020-01-26T15:24:23.468003+0000","last_unstale":"2020-01-26T15:24:33.384070+0000","last_undegraded":"2020-01-26T15:24:33.384070+0000","last_fullsized":"2020-01-26T15:24:33.384070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'5","reported_seq":"42","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.245425+0000","last_change":"2020-01-26T15:24:29.223979+0000","last_active":"2020-01-26T15:24:33.245425+0000","last_peered":"2020-01-26T15:24:33.245425+0000","last_clean":"2020-01-26T15:24:33.245425+0000","last_became_active":"2020-01-26T15:24:21.459309+0000","last_became_peered":"2020-01-26T15:24:21.459309+0000","last_unstale":"2020-01-26T15:24:33.245425+0000","last_undegraded":"2020-01-26T15:24:33.245425+0000","last_fullsized":"2020-01-26T15:24:33.245425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.384022+0000","last_change":"2020-01-26T15:24:21.460844+0000","last_active":"2020-01-26T15:24:33.384022+0000","last_peered":"2020-01-26T15:24:33.384022+0000","last_clean":"2020-01-26T15:24:33.384022+0000","last_became_active":"2020-01-26T15:24:21.460490+0000","last_became_peered":"2020-01-26T15:24:21.460490+0000","last_unstale":"2020-01-26T15:24:33.384022+0000","last_undegraded":"2020-01-26T15:24:33.384022+0000","last_fullsized":"2020-01-26T15:24:33.384022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242227+0000","last_change":"2020-01-26T15:24:22.464304+0000","last_active":"2020-01-26T15:24:33.242227+0000","last_peered":"2020-01-26T15:24:33.242227+0000","last_clean":"2020-01-26T15:24:33.242227+0000","last_became_active":"2020-01-26T15:24:22.463896+0000","last_became_peered":"2020-01-26T15:24:22.463896+0000","last_unstale":"2020-01-26T15:24:33.242227+0000","last_undegraded":"2020-01-26T15:24:33.242227+0000","last_fullsized":"2020-01-26T15:24:33.242227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'7","reported_seq":"40","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.243553+0000","last_change":"2020-01-26T15:24:29.226496+0000","last_active":"2020-01-26T15:24:33.243553+0000","last_peered":"2020-01-26T15:24:33.243553+0000","last_clean":"2020-01-26T15:24:33.243553+0000","last_became_active":"2020-01-26T15:24:22.469185+0000","last_became_peered":"2020-01-26T15:24:22.469185+0000","last_unstale":"2020-01-26T15:24:33.243553+0000","last_undegraded":"2020-01-26T15:24:33.243553+0000","last_fullsized":"2020-01-26T15:24:33.243553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.383817+0000","last_change":"2020-01-26T15:24:23.465630+0000","last_active":"2020-01-26T15:24:33.383817+0000","last_peered":"2020-01-26T15:24:33.383817+0000","last_clean":"2020-01-26T15:24:33.383817+0000","last_became_active":"2020-01-26T15:24:23.464992+0000","last_became_peered":"2020-01-26T15:24:23.464992+0000","last_unstale":"2020-01-26T15:24:33.383817+0000","last_undegraded":"2020-01-26T15:24:33.383817+0000","last_fullsized":"2020-01-26T15:24:33.383817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245186+0000","last_change":"2020-01-26T15:24:23.466427+0000","last_active":"2020-01-26T15:24:33.245186+0000","last_peered":"2020-01-26T15:24:33.245186+0000","last_clean":"2020-01-26T15:24:33.245186+0000","last_became_active":"2020-01-26T15:24:23.465833+0000","last_became_peered":"2020-01-26T15:24:23.465833+0000","last_unstale":"2020-01-26T15:24:33.245186+0000","last_undegraded":"2020-01-26T15:24:33.245186+0000","last_fullsized":"2020-01-26T15:24:33.245186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'8","reported_seq":"43","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241618+0000","last_change":"2020-01-26T15:24:22.468501+0000","last_active":"2020-01-26T15:24:33.241618+0000","last_peered":"2020-01-26T15:24:33.241618+0000","last_clean":"2020-01-26T15:24:33.241618+0000","last_became_active":"2020-01-26T15:24:22.468081+0000","last_became_peered":"2020-01-26T15:24:22.468081+0000","last_unstale":"2020-01-26T15:24:33.241618+0000","last_undegraded":"2020-01-26T15:24:33.241618+0000","last_fullsized":"2020-01-26T15:24:33.241618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245612+0000","last_change":"2020-01-26T15:24:23.464660+0000","last_active":"2020-01-26T15:24:33.245612+0000","last_peered":"2020-01-26T15:24:33.245612+0000","last_clean":"2020-01-26T15:24:33.245612+0000","last_became_active":"2020-01-26T15:24:23.464220+0000","last_became_peered":"2020-01-26T15:24:23.464220+0000","last_unstale":"2020-01-26T15:24:33.245612+0000","last_undegraded":"2020-01-26T15:24:33.245612+0000","last_fullsized":"2020-01-26T15:24:33.245612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.383716+0000","last_change":"2020-01-26T15:24:21.457953+0000","last_active":"2020-01-26T15:24:33.383716+0000","last_peered":"2020-01-26T15:24:33.383716+0000","last_clean":"2020-01-26T15:24:33.383716+0000","last_became_active":"2020-01-26T15:24:21.457575+0000","last_became_peered":"2020-01-26T15:24:21.457575+0000","last_unstale":"2020-01-26T15:24:33.383716+0000","last_undegraded":"2020-01-26T15:24:33.383716+0000","last_fullsized":"2020-01-26T15:24:33.383716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384202+0000","last_change":"2020-01-26T15:24:23.467470+0000","last_active":"2020-01-26T15:24:33.384202+0000","last_peered":"2020-01-26T15:24:33.384202+0000","last_clean":"2020-01-26T15:24:33.384202+0000","last_became_active":"2020-01-26T15:24:23.467179+0000","last_became_peered":"2020-01-26T15:24:23.467179+0000","last_unstale":"2020-01-26T15:24:33.384202+0000","last_undegraded":"2020-01-26T15:24:33.384202+0000","last_fullsized":"2020-01-26T15:24:33.384202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242279+0000","last_change":"2020-01-26T15:24:23.467577+0000","last_active":"2020-01-26T15:24:33.242279+0000","last_peered":"2020-01-26T15:24:33.242279+0000","last_clean":"2020-01-26T15:24:33.242279+0000","last_became_active":"2020-01-26T15:24:23.467251+0000","last_became_peered":"2020-01-26T15:24:23.467251+0000","last_unstale":"2020-01-26T15:24:33.242279+0000","last_undegraded":"2020-01-26T15:24:33.242279+0000","last_fullsized":"2020-01-26T15:24:33.242279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"33","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245123+0000","last_change":"2020-01-26T15:24:21.457984+0000","last_active":"2020-01-26T15:24:33.245123+0000","last_peered":"2020-01-26T15:24:33.245123+0000","last_clean":"2020-01-26T15:24:33.245123+0000","last_became_active":"2020-01-26T15:24:21.457642+0000","last_became_peered":"2020-01-26T15:24:21.457642+0000","last_unstale":"2020-01-26T15:24:33.245123+0000","last_undegraded":"2020-01-26T15:24:33.245123+0000","last_fullsized":"2020-01-26T15:24:33.245123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'5","reported_seq":"30","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.242125+0000","last_change":"2020-01-26T15:24:29.226180+0000","last_active":"2020-01-26T15:24:33.242125+0000","last_peered":"2020-01-26T15:24:33.242125+0000","last_clean":"2020-01-26T15:24:33.242125+0000","last_became_active":"2020-01-26T15:24:23.468441+0000","last_became_peered":"2020-01-26T15:24:23.468441+0000","last_unstale":"2020-01-26T15:24:33.242125+0000","last_undegraded":"2020-01-26T15:24:33.242125+0000","last_fullsized":"2020-01-26T15:24:33.242125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.383640+0000","last_change":"2020-01-26T15:24:23.466545+0000","last_active":"2020-01-26T15:24:33.383640+0000","last_peered":"2020-01-26T15:24:33.383640+0000","last_clean":"2020-01-26T15:24:33.383640+0000","last_became_active":"2020-01-26T15:24:23.466101+0000","last_became_peered":"2020-01-26T15:24:23.466101+0000","last_unstale":"2020-01-26T15:24:33.383640+0000","last_undegraded":"2020-01-26T15:24:33.383640+0000","last_fullsized":"2020-01-26T15:24:33.383640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241806+0000","last_change":"2020-01-26T15:24:22.468078+0000","last_active":"2020-01-26T15:24:33.241806+0000","last_peered":"2020-01-26T15:24:33.241806+0000","last_clean":"2020-01-26T15:24:33.241806+0000","last_became_active":"2020-01-26T15:24:22.467411+0000","last_became_peered":"2020-01-26T15:24:22.467411+0000","last_unstale":"2020-01-26T15:24:33.241806+0000","last_undegraded":"2020-01-26T15:24:33.241806+0000","last_fullsized":"2020-01-26T15:24:33.241806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'1","reported_seq":"36","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.241840+0000","last_change":"2020-01-26T15:24:22.466514+0000","last_active":"2020-01-26T15:24:33.241840+0000","last_peered":"2020-01-26T15:24:33.241840+0000","last_clean":"2020-01-26T15:24:33.241840+0000","last_became_active":"2020-01-26T15:24:22.466078+0000","last_became_peered":"2020-01-26T15:24:22.466078+0000","last_unstale":"2020-01-26T15:24:33.241840+0000","last_undegraded":"2020-01-26T15:24:33.241840+0000","last_fullsized":"2020-01-26T15:24:33.241840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean+wait","last_fresh":"2020-01-26T15:24:33.245444+0000","last_change":"2020-01-26T15:24:23.464681+0000","last_active":"2020-01-26T15:24:33.245444+0000","last_peered":"2020-01-26T15:24:33.245444+0000","last_clean":"2020-01-26T15:24:33.245444+0000","last_became_active":"2020-01-26T15:24:23.464296+0000","last_became_peered":"2020-01-26T15:24:23.464296+0000","last_unstale":"2020-01-26T15:24:33.245444+0000","last_undegraded":"2020-01-26T15:24:33.245444+0000","last_fullsized":"2020-01-26T15:24:33.245444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"34","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.242334+0000","last_change":"2020-01-26T15:24:22.464454+0000","last_active":"2020-01-26T15:24:33.242334+0000","last_peered":"2020-01-26T15:24:33.242334+0000","last_clean":"2020-01-26T15:24:33.242334+0000","last_became_active":"2020-01-26T15:24:22.464010+0000","last_became_peered":"2020-01-26T15:24:22.464010+0000","last_unstale":"2020-01-26T15:24:33.242334+0000","last_undegraded":"2020-01-26T15:24:33.242334+0000","last_fullsized":"2020-01-26T15:24:33.242334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"15'6","reported_seq":"39","reported_epoch":"32","state":"active+clean+laggy","last_fresh":"2020-01-26T15:24:33.242620+0000","last_change":"2020-01-26T15:24:29.226369+0000","last_active":"2020-01-26T15:24:33.242620+0000","last_peered":"2020-01-26T15:24:33.242620+0000","last_clean":"2020-01-26T15:24:33.242620+0000","last_became_active":"2020-01-26T15:24:22.466385+0000","last_became_peered":"2020-01-26T15:24:22.466385+0000","last_unstale":"2020-01-26T15:24:33.242620+0000","last_undegraded":"2020-01-26T15:24:33.242620+0000","last_fullsized":"2020-01-26T15:24:33.242620+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"31","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.384234+0000","last_change":"2020-01-26T15:24:23.468385+0000","last_active":"2020-01-26T15:24:33.384234+0000","last_peered":"2020-01-26T15:24:33.384234+0000","last_clean":"2020-01-26T15:24:33.384234+0000","last_became_active":"2020-01-26T15:24:23.467925+0000","last_became_peered":"2020-01-26T15:24:23.467925+0000","last_unstale":"2020-01-26T15:24:33.384234+0000","last_undegraded":"2020-01-26T15:24:33.384234+0000","last_fullsized":"2020-01-26T15:24:33.384234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:43.926777+0000","last_clean_scrub_stamp":"2020-01-26T15:21:43.926777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"32","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245347+0000","last_change":"2020-01-26T15:24:22.471996+0000","last_active":"2020-01-26T15:24:33.245347+0000","last_peered":"2020-01-26T15:24:33.245347+0000","last_clean":"2020-01-26T15:24:33.245347+0000","last_became_active":"2020-01-26T15:24:22.471594+0000","last_became_peered":"2020-01-26T15:24:22.471594+0000","last_unstale":"2020-01-26T15:24:33.245347+0000","last_undegraded":"2020-01-26T15:24:33.245347+0000","last_fullsized":"2020-01-26T15:24:33.245347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:40.897075+0000","last_clean_scrub_stamp":"2020-01-26T15:21:40.897075+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'14","reported_seq":"49","reported_epoch":"32","state":"active+clean","last_fresh":"2020-01-26T15:24:33.245236+0000","last_change":"2020-01-26T15:24:21.456458+0000","last_active":"2020-01-26T15:24:33.245236+0000","last_peered":"2020-01-26T15:24:33.245236+0000","last_clean":"2020-01-26T15:24:33.245236+0000","last_became_active":"2020-01-26T15:24:21.456052+0000","last_became_peered":"2020-01-26T15:24:21.456052+0000","last_unstale":"2020-01-26T15:24:33.245236+0000","last_undegraded":"2020-01-26T15:24:33.245236+0000","last_fullsized":"2020-01-26T15:24:33.245236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-01-26T15:21:42.921661+0000","last_clean_scrub_stamp":"2020-01-26T15:21:42.921661+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":5216,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":10432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049760,"kb_used_data":1168,"kb_used_omap":3,"kb_used_meta":1048572,"kb_avail":93322080,"statfs":{"total":96636764160,"available":95561809920,"internally_reserved":1073741824,"allocated":1196032,"data_stored":97494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3772,"internal_metadata":1073738052},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,5],"upper_bound":16384},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":25,"seq":107374182405,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049696,"kb_used_data":1104,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93322144,"statfs":{"total":96636764160,"available":95561875456,"internally_reserved":1073741824,"allocated":1130496,"data_stored":96768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4156,"internal_metadata":1073737668},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247813,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049760,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322080,"statfs":{"total":96636764160,"available":95561809920,"internally_reserved":1073741824,"allocated":1196032,"data_stored":98064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049728,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322112,"statfs":{"total":96636764160,"available":95561842688,"internally_reserved":1073741824,"allocated":1163264,"data_stored":101190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":16384},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}]}} 2020-01-26T15:24:38.652 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-01-26T15:24:38.652 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-01-26T15:24:38.653 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-01-26T15:24:38.653 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:38.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 Processor -- start 2020-01-26T15:24:38.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- start start 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 0x7fbbb80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80a6dc0 con 0x7fbbb805edd0 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb805ea20 con 0x7fbbb8149040 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb8098000 con 0x7fbbb805e5f0 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbe141700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 0x7fbbb80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbe942700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbbb805edd0 0x7fbbb807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48424/0 (socket says 172.21.15.129:48424) 2020-01-26T15:24:38.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbe942700 1 -- 172.21.15.129:0/2805169514 learned_addr learned my addr 172.21.15.129:0/2805169514 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbe141700 1 --2- 172.21.15.129:0/2805169514 >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 0x7fbbb80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506534800 0 0) 0x7fbbb805ea20 con 0x7fbbb8149040 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba4003230 con 0x7fbbb8149040 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301355844 0 0) 0x7fbbb80a6dc0 con 0x7fbbb805edd0 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb805ea20 con 0x7fbbb805edd0 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 545105667 0 0) 0x7fbba4003230 con 0x7fbbb8149040 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 msgr2=0x7fbbb80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:38.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 --2- 172.21.15.129:0/2805169514 >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 0x7fbbb80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:38.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 >> v1:172.21.15.129:6790/0 conn(0x7fbbb805edd0 legacy=0x7fbbb807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb805e050 con 0x7fbbb8149040 2020-01-26T15:24:38.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbbac001640 con 0x7fbbb8149040 2020-01-26T15:24:38.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbbac001910 con 0x7fbbb8149040 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbd940700 1 -- 172.21.15.129:0/2805169514 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbbac001ec0 con 0x7fbbb8149040 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- 172.21.15.129:0/2805169514 >> v1:172.21.15.129:6791/0 conn(0x7fbbb8149040 legacy=0x7fbbb814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- 172.21.15.129:0/2805169514 shutdown_connections 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 --2- 172.21.15.129:0/2805169514 >> v2:172.21.15.129:6791/0 conn(0x7fbbb805e5f0 0x7fbbb80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- 172.21.15.129:0/2805169514 >> 172.21.15.129:0/2805169514 conn(0x7fbbb8098e70 msgr2=0x7fbbb80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- 172.21.15.129:0/2805169514 shutdown_connections 2020-01-26T15:24:38.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.758+0000 7fbbbf143700 1 -- 172.21.15.129:0/2805169514 wait complete. 2020-01-26T15:24:38.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 Processor -- start 2020-01-26T15:24:38.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- start start 2020-01-26T15:24:38.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 0x7fbbb8079dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:38.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 0x7fbbb81205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:38.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb8144d90 con 0x7fbbb80247b0 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb811e420 con 0x7fbbb811ef00 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb811f830 con 0x7fbbb809dec0 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbe141700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 0x7fbbb81205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbe141700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 0x7fbbb81205a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbe942700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 0x7fbbb8079dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbc03a5700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbbb80247b0 0x7fbbb8024be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48434/0 (socket says 172.21.15.129:48434) 2020-01-26T15:24:38.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbc03a5700 1 -- 172.21.15.129:0/977338687 learned_addr learned my addr 172.21.15.129:0/977338687 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbe942700 1 --2- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 0x7fbbb8079dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825795074 0 0) 0x7fbbb8144d90 con 0x7fbbb80247b0 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba0003230 con 0x7fbbb80247b0 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2904910448 0 0) 0x7fbba0003230 con 0x7fbbb80247b0 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbbb8144d90 con 0x7fbbb80247b0 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbbac001350 con 0x7fbbb80247b0 2020-01-26T15:24:38.772 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2360617321 0 0) 0x7fbbb8144d90 con 0x7fbbb80247b0 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 msgr2=0x7fbbb81205a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 --2- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 0x7fbbb81205a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 msgr2=0x7fbbb8079dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 --2- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 0x7fbbb8079dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb809e2f0 con 0x7fbbb80247b0 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb81201f0 con 0x7fbbb80247b0 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb811f4b0 con 0x7fbbb80247b0 2020-01-26T15:24:38.773 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbbac001160 con 0x7fbbb80247b0 2020-01-26T15:24:38.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbbac002540 con 0x7fbbb80247b0 2020-01-26T15:24:38.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fbbac0027c0 con 0x7fbbb80247b0 2020-01-26T15:24:38.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.762+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94003360 con 0x7fbbb80247b0 2020-01-26T15:24:38.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.766+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7fbbac04b9f0 con 0x7fbbb80247b0 2020-01-26T15:24:38.774 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.770+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fbbac031010 con 0x7fbbb80247b0 2020-01-26T15:24:38.928 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb940037d0 con 0x7fbbb80247b0 2020-01-26T15:24:38.929 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbab7fe700 1 -- 172.21.15.129:0/977338687 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fbbac031bc0 con 0x7fbbb80247b0 2020-01-26T15:24:38.929 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:38.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 >> v1:172.21.15.129:6800/16899 conn(0x7fbba003e130 legacy=0x7fbba0040640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 >> v1:172.21.15.129:6790/0 conn(0x7fbbb80247b0 legacy=0x7fbbb8024be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:38.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 shutdown_connections 2020-01-26T15:24:38.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 --2- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6790/0 conn(0x7fbbb811ef00 0x7fbbb8079dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 --2- 172.21.15.129:0/977338687 >> v2:172.21.15.129:6791/0 conn(0x7fbbb809dec0 0x7fbbb81205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:38.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.926+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 >> 172.21.15.129:0/977338687 conn(0x7fbbb8098f20 msgr2=0x7fbbb807dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:38.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.930+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 shutdown_connections 2020-01-26T15:24:38.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:38.930+0000 7fbbbf143700 1 -- 172.21.15.129:0/977338687 wait complete. 2020-01-26T15:24:38.942 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:39.467 INFO:tasks.ceph.mds.c.smithi129.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:24:39.485 INFO:tasks.ceph.mds.c.smithi129.stderr: what(): buffer::end_of_buffer 2020-01-26T15:24:39.485 INFO:tasks.ceph.mds.c.smithi129.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:24:39.485 INFO:tasks.ceph.mds.c.smithi129.stderr: in thread 7f835884b700 thread_name:MR_Finisher 2020-01-26T15:24:39.486 INFO:tasks.ceph.mds.c.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:39.486 INFO:tasks.ceph.mds.c.smithi129.stderr: 1: (()+0x12890) [0x7f8365a49890] 2020-01-26T15:24:39.486 INFO:tasks.ceph.mds.c.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8364b41e97] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 3: (abort()+0x141) [0x7f8364b43801] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 4: (()+0x8c957) [0x7f8365536957] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 5: (()+0x92ab6) [0x7f836553cab6] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 6: (()+0x92af1) [0x7f836553caf1] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 7: (()+0x92d24) [0x7f836553cd24] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 8: (()+0x26a540) [0x7f8366130540] 2020-01-26T15:24:39.487 INFO:tasks.ceph.mds.c.smithi129.stderr: 9: (()+0x57ff67) [0x7f8366445f67] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5637b983b45d] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5637b983bdf6] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5637b983928c] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5637b9841d42] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5637b9842021] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8366184175] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 16: (()+0x76db) [0x7f8365a3e6db] 2020-01-26T15:24:39.488 INFO:tasks.ceph.mds.c.smithi129.stderr: 17: (clone()+0x3f) [0x7f8364c2488f] 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr:2020-01-26T15:24:39.482+0000 7f835884b700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: in thread 7f835884b700 thread_name:MR_Finisher 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: 1: (()+0x12890) [0x7f8365a49890] 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8364b41e97] 2020-01-26T15:24:39.489 INFO:tasks.ceph.mds.c.smithi129.stderr: 3: (abort()+0x141) [0x7f8364b43801] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 4: (()+0x8c957) [0x7f8365536957] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 5: (()+0x92ab6) [0x7f836553cab6] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 6: (()+0x92af1) [0x7f836553caf1] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 7: (()+0x92d24) [0x7f836553cd24] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 8: (()+0x26a540) [0x7f8366130540] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 9: (()+0x57ff67) [0x7f8366445f67] 2020-01-26T15:24:39.490 INFO:tasks.ceph.mds.c.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5637b983b45d] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5637b983bdf6] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5637b983928c] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5637b9841d42] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5637b9842021] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8366184175] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 16: (()+0x76db) [0x7f8365a3e6db] 2020-01-26T15:24:39.491 INFO:tasks.ceph.mds.c.smithi129.stderr: 17: (clone()+0x3f) [0x7f8364c2488f] 2020-01-26T15:24:39.492 INFO:tasks.ceph.mds.c.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:39.492 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.494 INFO:tasks.ceph.mds.c.smithi129.stderr: -466> 2020-01-26T15:24:28.578+0000 7f836105c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x5637bc4a5200 0x5637bd116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:39.494 INFO:tasks.ceph.mds.c.smithi129.stderr: -330> 2020-01-26T15:24:28.582+0000 7f836185d700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:39.495 INFO:tasks.ceph.mds.c.smithi129.stderr: -65> 2020-01-26T15:24:37.454+0000 7f835884b700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:24:39.495 INFO:tasks.ceph.mds.c.smithi129.stderr: 0> 2020-01-26T15:24:39.482+0000 7f835884b700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:39.495 INFO:tasks.ceph.mds.c.smithi129.stderr: in thread 7f835884b700 thread_name:MR_Finisher 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: 1: (()+0x12890) [0x7f8365a49890] 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8364b41e97] 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: 3: (abort()+0x141) [0x7f8364b43801] 2020-01-26T15:24:39.496 INFO:tasks.ceph.mds.c.smithi129.stderr: 4: (()+0x8c957) [0x7f8365536957] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 5: (()+0x92ab6) [0x7f836553cab6] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 6: (()+0x92af1) [0x7f836553caf1] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 7: (()+0x92d24) [0x7f836553cd24] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 8: (()+0x26a540) [0x7f8366130540] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 9: (()+0x57ff67) [0x7f8366445f67] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5637b983b45d] 2020-01-26T15:24:39.497 INFO:tasks.ceph.mds.c.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5637b983bdf6] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5637b983928c] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5637b9841d42] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5637b9842021] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8366184175] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 16: (()+0x76db) [0x7f8365a3e6db] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 17: (clone()+0x3f) [0x7f8364c2488f] 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:39.498 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: -466> 2020-01-26T15:24:28.578+0000 7f836105c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x5637bc4a5200 0x5637bd116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: -330> 2020-01-26T15:24:28.582+0000 7f836185d700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: -65> 2020-01-26T15:24:37.454+0000 7f835884b700 -1 mds.0.openfiles _load_finish: corrupted header/values: buffer::end_of_buffer 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: 0> 2020-01-26T15:24:39.482+0000 7f835884b700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: in thread 7f835884b700 thread_name:MR_Finisher 2020-01-26T15:24:39.499 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: 1: (()+0x12890) [0x7f8365a49890] 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8364b41e97] 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: 3: (abort()+0x141) [0x7f8364b43801] 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: 4: (()+0x8c957) [0x7f8365536957] 2020-01-26T15:24:39.500 INFO:tasks.ceph.mds.c.smithi129.stderr: 5: (()+0x92ab6) [0x7f836553cab6] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 6: (()+0x92af1) [0x7f836553caf1] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 7: (()+0x92d24) [0x7f836553cd24] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 8: (()+0x26a540) [0x7f8366130540] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 9: (()+0x57ff67) [0x7f8366445f67] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5637b983b45d] 2020-01-26T15:24:39.501 INFO:tasks.ceph.mds.c.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5637b983bdf6] 2020-01-26T15:24:39.502 INFO:tasks.ceph.mds.c.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5637b983928c] 2020-01-26T15:24:39.502 INFO:tasks.ceph.mds.c.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5637b9841d42] 2020-01-26T15:24:39.502 INFO:tasks.ceph.mds.c.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5637b9842021] 2020-01-26T15:24:39.502 INFO:tasks.ceph.mds.c.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8366184175] 2020-01-26T15:24:39.502 INFO:tasks.ceph.mds.c.smithi129.stderr: 16: (()+0x76db) [0x7f8365a3e6db] 2020-01-26T15:24:39.503 INFO:tasks.ceph.mds.c.smithi129.stderr: 17: (clone()+0x3f) [0x7f8364c2488f] 2020-01-26T15:24:39.503 INFO:tasks.ceph.mds.c.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:39.503 INFO:tasks.ceph.mds.c.smithi129.stderr: 2020-01-26T15:24:39.582 INFO:tasks.ceph.mds.c.smithi129.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:24:41.943 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:42.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.054+0000 7f59ad591700 1 Processor -- start 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.054+0000 7f59ad591700 1 -- start start 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 0x7f59a80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 0x7f59a814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80a6dc0 con 0x7f59a805edd0 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f59a805ea20 con 0x7f59a8149040 2020-01-26T15:24:42.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f59a8098000 con 0x7f59a805e5f0 2020-01-26T15:24:42.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ae7f3700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 0x7f59a814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:42.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59acd90700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f59a805edd0 0x7f59a807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48438/0 (socket says 172.21.15.129:48438) 2020-01-26T15:24:42.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59acd90700 1 -- 172.21.15.129:0/57482531 learned_addr learned my addr 172.21.15.129:0/57482531 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:42.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a7fff700 -1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 0x7f59a80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 0x7f59a814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a7fff700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 0x7f59a80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706963188 0 0) 0x7f59a80a6dc0 con 0x7f59a805edd0 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5990003230 con 0x7f59a805edd0 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1276202246 0 0) 0x7f5990003230 con 0x7f59a805edd0 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 msgr2=0x7f59a80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:42.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 0x7f59a80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 msgr2=0x7f59a814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 0x7f59a814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a805e050 con 0x7f59a805edd0 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5998001a90 con 0x7f59a805edd0 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5998001e20 con 0x7f59a805edd0 2020-01-26T15:24:42.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59a77fe700 1 -- 172.21.15.129:0/57482531 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5998004ae0 con 0x7f59a805edd0 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- 172.21.15.129:0/57482531 >> v1:172.21.15.129:6790/0 conn(0x7f59a805edd0 legacy=0x7f59a807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- 172.21.15.129:0/57482531 shutdown_connections 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6790/0 conn(0x7f59a8149040 0x7f59a814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 --2- 172.21.15.129:0/57482531 >> v2:172.21.15.129:6791/0 conn(0x7f59a805e5f0 0x7f59a80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- 172.21.15.129:0/57482531 >> 172.21.15.129:0/57482531 conn(0x7f59a8098e70 msgr2=0x7f59a80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- 172.21.15.129:0/57482531 shutdown_connections 2020-01-26T15:24:42.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.058+0000 7f59ad591700 1 -- 172.21.15.129:0/57482531 wait complete. 2020-01-26T15:24:42.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 Processor -- start 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- start start 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f59a81375f0 0x7f59a8139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a809f270 con 0x7f59a811dfc0 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a809f870 con 0x7f59a809fc00 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f59a812dde0 con 0x7f59a81375f0 2020-01-26T15:24:42.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59acd90700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f59a809fc00 0x7f59a812e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46064/0 (socket says 172.21.15.129:46064) 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59acd90700 1 -- 172.21.15.129:0/3867162281 learned_addr learned my addr 172.21.15.129:0/3867162281 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 -1 --2- 172.21.15.129:0/3867162281 >> v2:172.21.15.129:6791/0 conn(0x7f59a81375f0 0x7f59a8139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> v2:172.21.15.129:6791/0 conn(0x7f59a81375f0 0x7f59a8139a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367013847 0 0) 0x7f59a809f870 con 0x7f59a809fc00 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5988003230 con 0x7f59a809fc00 2020-01-26T15:24:42.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062783357 0 0) 0x7f59a809f270 con 0x7f59a811dfc0 2020-01-26T15:24:42.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a809f870 con 0x7f59a811dfc0 2020-01-26T15:24:42.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1799642735 0 0) 0x7f5988003230 con 0x7f59a809fc00 2020-01-26T15:24:42.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f59a809f270 con 0x7f59a809fc00 2020-01-26T15:24:42.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5998004b60 con 0x7f59a809fc00 2020-01-26T15:24:42.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 931728064 0 0) 0x7f59a809f870 con 0x7f59a811dfc0 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5988003230 con 0x7f59a811dfc0 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f599c001620 con 0x7f59a811dfc0 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 >> v2:172.21.15.129:6791/0 conn(0x7f59a81375f0 msgr2=0x7f59a8139a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 --2- 172.21.15.129:0/3867162281 >> v2:172.21.15.129:6791/0 conn(0x7f59a81375f0 0x7f59a8139a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 >> v1:172.21.15.129:6791/0 conn(0x7f59a809fc00 legacy=0x7f59a812e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 >> v1:172.21.15.129:6789/0 conn(0x7f59a811dfc0 legacy=0x7f59a811e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5988003230 con 0x7f5988003d40 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f59a809f870 con 0x7f5988004ee0 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a812dde0 con 0x7f598800c000 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353681429 0 0) 0x7f59a809f870 con 0x7f5988004ee0 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5988004310 con 0x7f5988004ee0 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710950284 0 0) 0x7f5988003230 con 0x7f5988003d40 2020-01-26T15:24:42.076 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 -- 172.21.15.129:0/3867162281 >> v1:172.21.15.129:6791/0 conn(0x7f5988004ee0 legacy=0x7f5988003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 -- 172.21.15.129:0/3867162281 >> v1:172.21.15.129:6790/0 conn(0x7f5988003d40 legacy=0x7f598800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f59a812eae0 con 0x7f598800c000 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a80a0e30 con 0x7f598800c000 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a809fda0 con 0x7f598800c000 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.077 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.062+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f5998004db0 con 0x7f598800c000 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0005d00 con 0x7f598800c000 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a8056600 con 0x7f598800c000 2020-01-26T15:24:42.078 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f59a000a320 con 0x7f598800c000 2020-01-26T15:24:42.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.066+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f59a004cb20 con 0x7f598800c000 2020-01-26T15:24:42.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.070+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.079 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.070+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f59a0032c30 con 0x7f598800c000 2020-01-26T15:24:42.230 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.226+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f59a80a6c90 con 0x7f598800c000 2020-01-26T15:24:42.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ae7f3700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:42.231 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59a57fa700 1 -- 172.21.15.129:0/3867162281 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f59a0032e90 con 0x7f598800c000 2020-01-26T15:24:42.231 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 >> v1:172.21.15.129:6800/16899 conn(0x7f5988048460 legacy=0x7f598804a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 msgr2=0x7f598800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ae7f3700 1 -- 172.21.15.129:0/3867162281 reap_dead start 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f5998002120 tx=0x7f59a0010940).stop 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 shutdown_connections 2020-01-26T15:24:42.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 --2- 172.21.15.129:0/3867162281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f598800c000 0x7f598800e440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:42.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 >> 172.21.15.129:0/3867162281 conn(0x7f59a8124160 msgr2=0x7f59a807f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:42.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 shutdown_connections 2020-01-26T15:24:42.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:42.230+0000 7f59ad591700 1 -- 172.21.15.129:0/3867162281 wait complete. 2020-01-26T15:24:42.243 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:45.244 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:45.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 Processor -- start 2020-01-26T15:24:45.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 -- start start 2020-01-26T15:24:45.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 0x7f7c6c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c098000 con 0x7f7c6c149040 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c05e050 con 0x7f7c6c0a6870 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c72fcd700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0a6ca0 con 0x7f7c6c05edd0 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c71fcb700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f7c6c0a6870 0x7f7c6c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46074/0 (socket says 172.21.15.129:46074) 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c71fcb700 1 -- 172.21.15.129:0/1778907092 learned_addr learned my addr 172.21.15.129:0/1778907092 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c727cc700 -1 --2- 172.21.15.129:0/1778907092 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 0x7f7c6c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:45.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c727cc700 1 --2- 172.21.15.129:0/1778907092 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 0x7f7c6c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043213794 0 0) 0x7f7c6c05e050 con 0x7f7c6c0a6870 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c58003230 con 0x7f7c6c0a6870 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225689243 0 0) 0x7f7c6c098000 con 0x7f7c6c149040 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.358+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6c05e050 con 0x7f7c6c149040 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1193095917 0 0) 0x7f7c58003230 con 0x7f7c6c0a6870 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 msgr2=0x7f7c6c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 --2- 172.21.15.129:0/1778907092 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 0x7f7c6c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:45.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 >> v1:172.21.15.129:6789/0 conn(0x7f7c6c149040 legacy=0x7f7c6c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c14ecb0 con 0x7f7c6c0a6870 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7c5c001710 con 0x7f7c6c0a6870 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c5c001990 con 0x7f7c6c0a6870 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c717ca700 1 -- 172.21.15.129:0/1778907092 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7c5c0045b0 con 0x7f7c6c0a6870 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- 172.21.15.129:0/1778907092 >> v1:172.21.15.129:6791/0 conn(0x7f7c6c0a6870 legacy=0x7f7c6c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- 172.21.15.129:0/1778907092 shutdown_connections 2020-01-26T15:24:45.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 --2- 172.21.15.129:0/1778907092 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c05edd0 0x7f7c6c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- 172.21.15.129:0/1778907092 >> 172.21.15.129:0/1778907092 conn(0x7f7c6c098e70 msgr2=0x7f7c6c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- 172.21.15.129:0/1778907092 shutdown_connections 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- 172.21.15.129:0/1778907092 wait complete. 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 Processor -- start 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.362+0000 7f7c72fcd700 1 -- start start 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 0x7f7c6c0a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:45.373 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0a0cd0 con 0x7f7c6c0a1590 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c07d6a0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c121bb0 con 0x7f7c6c0a0350 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c727cc700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f7c6c0a1590 0x7f7c6c07cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48464/0 (socket says 172.21.15.129:48464) 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c727cc700 1 -- 172.21.15.129:0/201930200 learned_addr learned my addr 172.21.15.129:0/201930200 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c71fcb700 -1 --2- 172.21.15.129:0/201930200 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 0x7f7c6c0a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c71fcb700 1 --2- 172.21.15.129:0/201930200 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 0x7f7c6c0a0780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:45.374 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159458429 0 0) 0x7f7c6c07d6a0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c54003230 con 0x7f7c6c1386f0 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009441740 0 0) 0x7f7c6c0a0cd0 con 0x7f7c6c0a1590 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6c07d6a0 con 0x7f7c6c0a1590 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3661451383 0 0) 0x7f7c54003230 con 0x7f7c6c1386f0 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c6c0a0cd0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7c64001d30 con 0x7f7c6c1386f0 2020-01-26T15:24:45.375 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1481466084 0 0) 0x7f7c6c07d6a0 con 0x7f7c6c0a1590 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c54003230 con 0x7f7c6c0a1590 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7c68002670 con 0x7f7c6c0a1590 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 193890330 0 0) 0x7f7c6c0a0cd0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 msgr2=0x7f7c6c0a0780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 --2- 172.21.15.129:0/201930200 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 0x7f7c6c0a0780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 >> v1:172.21.15.129:6790/0 conn(0x7f7c6c0a1590 legacy=0x7f7c6c07cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c122dd0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.376 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c09f6b0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0a19c0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c640023b0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.377 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7c64002810 con 0x7f7c6c1386f0 2020-01-26T15:24:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f7c64002a10 con 0x7f7c6c1386f0 2020-01-26T15:24:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7f7c64049630 con 0x7f7c6c1386f0 2020-01-26T15:24:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.366+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c48003360 con 0x7f7c6c1386f0 2020-01-26T15:24:45.378 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.374+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f7c6402ec70 con 0x7f7c6c1386f0 2020-01-26T15:24:45.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.522+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7c480037d0 con 0x7f7c6c1386f0 2020-01-26T15:24:45.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.522+0000 7f7c62ffd700 1 -- 172.21.15.129:0/201930200 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f7c6402f820 con 0x7f7c6c1386f0 2020-01-26T15:24:45.526 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 >> v1:172.21.15.129:6800/16899 conn(0x7f7c5403e560 legacy=0x7f7c54040a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 >> v1:172.21.15.129:6791/0 conn(0x7f7c6c1386f0 legacy=0x7f7c6c13ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:45.527 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 shutdown_connections 2020-01-26T15:24:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 --2- 172.21.15.129:0/201930200 >> v2:172.21.15.129:6790/0 conn(0x7f7c6c0a0350 0x7f7c6c0a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 >> 172.21.15.129:0/201930200 conn(0x7f7c6c07f6b0 msgr2=0x7f7c6c09de10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 shutdown_connections 2020-01-26T15:24:45.528 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:45.526+0000 7f7c72fcd700 1 -- 172.21.15.129:0/201930200 wait complete. 2020-01-26T15:24:45.538 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:48.540 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:48.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.654+0000 7f73c742a700 1 Processor -- start 2020-01-26T15:24:48.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.654+0000 7f73c742a700 1 -- start start 2020-01-26T15:24:48.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f73c00a5750 0x7f73c00a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:48.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c00a4b50 0x7f73c005ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:48.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00a5b80 con 0x7f73c005efa0 2020-01-26T15:24:48.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f73c00a43f0 con 0x7f73c00a5750 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f73c00a4f80 con 0x7f73c00a4b50 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c51c6700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c00a4b50 0x7f73c005ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c51c6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c00a4b50 0x7f73c005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c59c7700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f73c00a5750 0x7f73c00a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c59c7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f73c00a5750 0x7f73c00a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:48.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f73c005efa0 0x7f73c014ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40176/0 (socket says 172.21.15.129:40176) 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 -- 172.21.15.129:0/3213358210 learned_addr learned my addr 172.21.15.129:0/3213358210 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977741531 0 0) 0x7f73c00a5b80 con 0x7f73c005efa0 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac003230 con 0x7f73c005efa0 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2894162160 0 0) 0x7f73ac003230 con 0x7f73c005efa0 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 >> v2:172.21.15.129:6791/0 conn(0x7f73c00a4b50 msgr2=0x7f73c005ea50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:48.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 --2- 172.21.15.129:0/3213358210 >> v2:172.21.15.129:6791/0 conn(0x7f73c00a4b50 0x7f73c005ea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 >> v2:172.21.15.129:6790/0 conn(0x7f73c00a5750 msgr2=0x7f73c00a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 --2- 172.21.15.129:0/3213358210 >> v2:172.21.15.129:6790/0 conn(0x7f73c00a5750 0x7f73c00a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0080440 con 0x7f73c005efa0 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f73b8001a90 con 0x7f73c005efa0 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 >> v1:172.21.15.129:6789/0 conn(0x7f73c005efa0 legacy=0x7f73c014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73ac003230 con 0x7f73ac0077d0 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73c00a5b80 con 0x7f73ac003860 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00a43f0 con 0x7f73ac00b5a0 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381124750 0 0) 0x7f73ac003230 con 0x7f73ac0077d0 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac00f710 con 0x7f73ac0077d0 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312672177 0 0) 0x7f73c00a5b80 con 0x7f73ac003860 2020-01-26T15:24:48.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac003230 con 0x7f73ac003860 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 -- 172.21.15.129:0/3213358210 >> v1:172.21.15.129:6791/0 conn(0x7f73ac003860 legacy=0x7f73ac003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 -- 172.21.15.129:0/3213358210 >> v1:172.21.15.129:6790/0 conn(0x7f73ac0077d0 legacy=0x7f73ac009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 -- 172.21.15.129:0/3213358210 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac00f360 con 0x7f73ac00b5a0 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f73b8001340 tx=0x7f73b800c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 -- 172.21.15.129:0/3213358210 reap_dead start 2020-01-26T15:24:48.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f73b8001340 tx=0x7f73b800c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f73b8001340 tx=0x7f73b800c5f0).ready entity=mon.0 client_cookie=bf79549a6f6055c1 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f73b8001340 tx=0x7f73b800c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73b8005d60 con 0x7f73ac00b5a0 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f73b8001340 tx=0x7f73b800c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b8010160 con 0x7f73ac00b5a0 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c61c8700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f73b8001340 tx=0x7f73b800c5f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c49c5700 1 -- 172.21.15.129:0/3213358210 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73b8010500 con 0x7f73ac00b5a0 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 msgr2=0x7f73ac00dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f73b8001340 tx=0x7f73b800c5f0).stop 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- 172.21.15.129:0/3213358210 shutdown_connections 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 --2- 172.21.15.129:0/3213358210 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73ac00b5a0 0x7f73ac00dab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- 172.21.15.129:0/3213358210 >> 172.21.15.129:0/3213358210 conn(0x7f73c005e050 msgr2=0x7f73c0098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.658+0000 7f73c742a700 1 -- 172.21.15.129:0/3213358210 shutdown_connections 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.662+0000 7f73c742a700 1 -- 172.21.15.129:0/3213358210 wait complete. 2020-01-26T15:24:48.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.662+0000 7f73c742a700 1 Processor -- start 2020-01-26T15:24:48.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.662+0000 7f73c742a700 1 -- start start 2020-01-26T15:24:48.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f73c0123f10 0x7f73c0094730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:48.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c007f8e0 0x7f73c0121150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c0095f40 con 0x7f73c01216a0 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f73c007fd10 con 0x7f73c0123f10 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f73c0096c30 con 0x7f73c007f8e0 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c51c6700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c007f8e0 0x7f73c0121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c51c6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f73c007f8e0 0x7f73c0121150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f73c0123f10 0x7f73c0094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:48.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c61c8700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f73c01216a0 0x7f73c007b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40188/0 (socket says 172.21.15.129:40188) 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c61c8700 1 -- 172.21.15.129:0/3377313078 learned_addr learned my addr 172.21.15.129:0/3377313078 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> v2:172.21.15.129:6790/0 conn(0x7f73c0123f10 0x7f73c0094730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076996001 0 0) 0x7f73c0095f40 con 0x7f73c01216a0 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a8003230 con 0x7f73c01216a0 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 616151836 0 0) 0x7f73a8003230 con 0x7f73c01216a0 2020-01-26T15:24:48.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73c0095f40 con 0x7f73c01216a0 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f73b80018e0 con 0x7f73c01216a0 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 >> v2:172.21.15.129:6791/0 conn(0x7f73c007f8e0 msgr2=0x7f73c0121150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 --2- 172.21.15.129:0/3377313078 >> v2:172.21.15.129:6791/0 conn(0x7f73c007f8e0 0x7f73c0121150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 >> v2:172.21.15.129:6790/0 conn(0x7f73c0123f10 msgr2=0x7f73c0094730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 --2- 172.21.15.129:0/3377313078 >> v2:172.21.15.129:6790/0 conn(0x7f73c0123f10 0x7f73c0094730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 >> v1:172.21.15.129:6789/0 conn(0x7f73c01216a0 legacy=0x7f73c007b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:48.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73a8003230 con 0x7f73a800a7f0 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f73a800f450 con 0x7f73a80045a0 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c007fd10 con 0x7f73a8003a20 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122787013 0 0) 0x7f73a800f450 con 0x7f73a80045a0 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a800e440 con 0x7f73a80045a0 2020-01-26T15:24:48.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297388325 0 0) 0x7f73a8003230 con 0x7f73a800a7f0 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a800f450 con 0x7f73a800a7f0 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 -- 172.21.15.129:0/3377313078 >> v1:172.21.15.129:6791/0 conn(0x7f73a80045a0 legacy=0x7f73a80049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 -- 172.21.15.129:0/3377313078 >> v1:172.21.15.129:6790/0 conn(0x7f73a800a7f0 legacy=0x7f73a800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c61c8700 1 -- 172.21.15.129:0/3377313078 reap_dead start 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0096540 con 0x7f73a8003a20 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c007f8e0 con 0x7f73a8003a20 2020-01-26T15:24:48.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c01240b0 con 0x7f73a8003a20 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73bc009b70 con 0x7f73a8003a20 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc009d70 con 0x7f73a8003a20 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f73bc009350 con 0x7f73a8003a20 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f73bc009550 con 0x7f73a8003a20 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.666+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c003360 con 0x7f73a8003a20 2020-01-26T15:24:48.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.670+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (secure 0 0 0) 0x7f73bc04ce80 con 0x7f73a8003a20 2020-01-26T15:24:48.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.674+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.674+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f73bc033030 con 0x7f73a8003a20 2020-01-26T15:24:48.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.830+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f739c003790 con 0x7f73a8003a20 2020-01-26T15:24:48.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.830+0000 7f73c59c7700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:48.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.830+0000 7f73b67fc700 1 -- 172.21.15.129:0/3377313078 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f73bc033290 con 0x7f73a8003a20 2020-01-26T15:24:48.833 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:48.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 >> v1:172.21.15.129:6800/16899 conn(0x7f73a8040aa0 legacy=0x7f73a8042fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 msgr2=0x7f73a8003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f73bc0056d0 tx=0x7f73bc010990).stop 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 shutdown_connections 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 --2- 172.21.15.129:0/3377313078 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f73a8003a20 0x7f73a8003e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 >> 172.21.15.129:0/3377313078 conn(0x7f73c0098160 msgr2=0x7f73c011ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:48.837 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 shutdown_connections 2020-01-26T15:24:48.838 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:48.834+0000 7f73c742a700 1 -- 172.21.15.129:0/3377313078 wait complete. 2020-01-26T15:24:48.850 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:51.852 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:51.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 Processor -- start 2020-01-26T15:24:51.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 -- start start 2020-01-26T15:24:51.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f6fc405e5f0 0x7f6fc40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:51.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc40a6dc0 con 0x7f6fc4149040 2020-01-26T15:24:51.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc405ea20 con 0x7f6fc405edd0 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc8817700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc4098000 con 0x7f6fc405e5f0 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc9018700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f6fc4149040 0x7f6fc414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40202/0 (socket says 172.21.15.129:40202) 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc9018700 1 -- 172.21.15.129:0/3152280883 learned_addr learned my addr 172.21.15.129:0/3152280883 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc2d9d700 -1 --2- 172.21.15.129:0/3152280883 >> v2:172.21.15.129:6791/0 conn(0x7f6fc405e5f0 0x7f6fc40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc2d9d700 1 --2- 172.21.15.129:0/3152280883 >> v2:172.21.15.129:6791/0 conn(0x7f6fc405e5f0 0x7f6fc40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967502763 0 0) 0x7f6fc40a6dc0 con 0x7f6fc4149040 2020-01-26T15:24:51.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fac003230 con 0x7f6fc4149040 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597074482 0 0) 0x7f6fc405ea20 con 0x7f6fc405edd0 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.970+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc40a6dc0 con 0x7f6fc405edd0 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1340009082 0 0) 0x7f6fac003230 con 0x7f6fc4149040 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 >> v2:172.21.15.129:6791/0 conn(0x7f6fc405e5f0 msgr2=0x7f6fc40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 --2- 172.21.15.129:0/3152280883 >> v2:172.21.15.129:6791/0 conn(0x7f6fc405e5f0 0x7f6fc40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 >> v1:172.21.15.129:6790/0 conn(0x7f6fc405edd0 legacy=0x7f6fc407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc405e050 con 0x7f6fc4149040 2020-01-26T15:24:51.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6fbc001a90 con 0x7f6fc4149040 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 >> v1:172.21.15.129:6789/0 conn(0x7f6fc4149040 legacy=0x7f6fc414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6fac003230 con 0x7f6fac003f90 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6fc405ea20 con 0x7f6fac003ac0 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4098000 con 0x7f6fac00b800 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:51.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685255792 0 0) 0x7f6fac003230 con 0x7f6fac003f90 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fac00e2f0 con 0x7f6fac003f90 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 -- 172.21.15.129:0/3152280883 >> v1:172.21.15.129:6791/0 conn(0x7f6fac003ac0 legacy=0x7f6fac0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197550348 0 0) 0x7f6fc405ea20 con 0x7f6fac003ac0 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 -- 172.21.15.129:0/3152280883 >> v1:172.21.15.129:6790/0 conn(0x7f6fac003f90 legacy=0x7f6fac004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 -- 172.21.15.129:0/3152280883 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac054560 con 0x7f6fac00b800 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:51.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).ready entity=mon.0 client_cookie=515df56919bf0569 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6fbc005cc0 con 0x7f6fac00b800 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc004d20 con 0x7f6fac00b800 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc259c700 1 -- 172.21.15.129:0/3152280883 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6fbc0050c0 con 0x7f6fac00b800 2020-01-26T15:24:51.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 -- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 msgr2=0x7f6fac00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 --2- 172.21.15.129:0/3152280883 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6fac00b800 0x7f6fac00dc40 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f6fbc0018a0 tx=0x7f6fbc00c4a0).stop 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc9018700 1 -- 172.21.15.129:0/3152280883 reap_dead start 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 -- 172.21.15.129:0/3152280883 shutdown_connections 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 -- 172.21.15.129:0/3152280883 >> 172.21.15.129:0/3152280883 conn(0x7f6fc4098e70 msgr2=0x7f6fc40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 -- 172.21.15.129:0/3152280883 shutdown_connections 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.974+0000 7f6fc8817700 1 -- 172.21.15.129:0/3152280883 wait complete. 2020-01-26T15:24:51.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 Processor -- start 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- start start 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 0x7f6fc4138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc409f000 con 0x7f6fc41304d0 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc409fca0 con 0x7f6fc409f870 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc40a3c50 con 0x7f6fc4136810 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc2d9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f6fc41304d0 0x7f6fc4135000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48512/0 (socket says 172.21.15.129:48512) 2020-01-26T15:24:51.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc359e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f6fc409f870 0x7f6fc40a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46126/0 (socket says 172.21.15.129:46126) 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc2d9d700 1 -- 172.21.15.129:0/2011763318 learned_addr learned my addr 172.21.15.129:0/2011763318 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc9018700 -1 --2- 172.21.15.129:0/2011763318 >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 0x7f6fc4138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc9018700 1 --2- 172.21.15.129:0/2011763318 >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 0x7f6fc4138c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405477251 0 0) 0x7f6fac00e2f0 con 0x7f6fc41304d0 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa4003230 con 0x7f6fc41304d0 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962344620 0 0) 0x7f6fc409fca0 con 0x7f6fc409f870 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fac00e2f0 con 0x7f6fc409f870 2020-01-26T15:24:51.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1505173581 0 0) 0x7f6fa4003230 con 0x7f6fc41304d0 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6fc409fca0 con 0x7f6fc41304d0 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6fb8002750 con 0x7f6fc41304d0 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3750929033 0 0) 0x7f6fac00e2f0 con 0x7f6fc409f870 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6fa4003230 con 0x7f6fc409f870 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6fb40029d0 con 0x7f6fc409f870 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3726574065 0 0) 0x7f6fc409fca0 con 0x7f6fc41304d0 2020-01-26T15:24:51.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 msgr2=0x7f6fc4138c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 --2- 172.21.15.129:0/2011763318 >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 0x7f6fc4138c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 >> v1:172.21.15.129:6791/0 conn(0x7f6fc409f870 legacy=0x7f6fc40a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40a3a20 con 0x7f6fc41304d0 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc4099d70 con 0x7f6fc41304d0 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6fb8001020 con 0x7f6fc41304d0 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6fb8001440 con 0x7f6fc41304d0 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc4130aa0 con 0x7f6fc41304d0 2020-01-26T15:24:51.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f6fb8001640 con 0x7f6fc41304d0 2020-01-26T15:24:51.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(33..33 src has 1..33) v4 ==== 3301+0+0 (unknown 2077070850 0 0) 0x7f6fc409f000 con 0x7f6fc41304d0 2020-01-26T15:24:51.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.978+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc4056600 con 0x7f6fc41304d0 2020-01-26T15:24:51.994 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:51.986+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f6fc4130aa0 con 0x7f6fc41304d0 2020-01-26T15:24:52.144 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.142+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6fc409f640 con 0x7f6fc41304d0 2020-01-26T15:24:52.145 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.142+0000 7f6fabfff700 1 -- 172.21.15.129:0/2011763318 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f6fb8030f90 con 0x7f6fc41304d0 2020-01-26T15:24:52.145 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 >> v1:172.21.15.129:6800/16899 conn(0x7f6fa403e440 legacy=0x7f6fa4040950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 >> v1:172.21.15.129:6790/0 conn(0x7f6fc41304d0 legacy=0x7f6fc4135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 shutdown_connections 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 --2- 172.21.15.129:0/2011763318 >> v2:172.21.15.129:6791/0 conn(0x7f6fc4136810 0x7f6fc4138c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 >> 172.21.15.129:0/2011763318 conn(0x7f6fc405e5f0 msgr2=0x7f6fc40247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:52.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 shutdown_connections 2020-01-26T15:24:52.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:52.146+0000 7f6fc8817700 1 -- 172.21.15.129:0/2011763318 wait complete. 2020-01-26T15:24:52.165 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:54.170 INFO:tasks.ceph.mds.a.smithi129.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:24:54.170 INFO:tasks.ceph.mds.a.smithi129.stderr: what(): buffer::end_of_buffer 2020-01-26T15:24:54.170 INFO:tasks.ceph.mds.a.smithi129.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:24:54.171 INFO:tasks.ceph.mds.a.smithi129.stderr: in thread 7f8bd014f700 thread_name:MR_Finisher 2020-01-26T15:24:54.171 INFO:tasks.ceph.mds.a.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:54.172 INFO:tasks.ceph.mds.a.smithi129.stderr: 1: (()+0x12890) [0x7f8bdd34d890] 2020-01-26T15:24:54.172 INFO:tasks.ceph.mds.a.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8bdc445e97] 2020-01-26T15:24:54.172 INFO:tasks.ceph.mds.a.smithi129.stderr: 3: (abort()+0x141) [0x7f8bdc447801] 2020-01-26T15:24:54.172 INFO:tasks.ceph.mds.a.smithi129.stderr: 4: (()+0x8c957) [0x7f8bdce3a957] 2020-01-26T15:24:54.172 INFO:tasks.ceph.mds.a.smithi129.stderr: 5: (()+0x92ab6) [0x7f8bdce40ab6] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 6: (()+0x92af1) [0x7f8bdce40af1] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 7: (()+0x92d24) [0x7f8bdce40d24] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 8: (()+0x26a540) [0x7f8bdda34540] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 9: (()+0x57ff67) [0x7f8bddd49f67] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5562d71bd45d] 2020-01-26T15:24:54.173 INFO:tasks.ceph.mds.a.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5562d71bddf6] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5562d71bb28c] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5562d71c3d42] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5562d71c4021] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8bdda88175] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 16: (()+0x76db) [0x7f8bdd3426db] 2020-01-26T15:24:54.174 INFO:tasks.ceph.mds.a.smithi129.stderr: 17: (clone()+0x3f) [0x7f8bdc52888f] 2020-01-26T15:24:54.175 INFO:tasks.ceph.mds.a.smithi129.stderr:2020-01-26T15:24:54.170+0000 7f8bd014f700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:54.175 INFO:tasks.ceph.mds.a.smithi129.stderr: in thread 7f8bd014f700 thread_name:MR_Finisher 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 1: (()+0x12890) [0x7f8bdd34d890] 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8bdc445e97] 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 3: (abort()+0x141) [0x7f8bdc447801] 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 4: (()+0x8c957) [0x7f8bdce3a957] 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 5: (()+0x92ab6) [0x7f8bdce40ab6] 2020-01-26T15:24:54.176 INFO:tasks.ceph.mds.a.smithi129.stderr: 6: (()+0x92af1) [0x7f8bdce40af1] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 7: (()+0x92d24) [0x7f8bdce40d24] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 8: (()+0x26a540) [0x7f8bdda34540] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 9: (()+0x57ff67) [0x7f8bddd49f67] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5562d71bd45d] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5562d71bddf6] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5562d71bb28c] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5562d71c3d42] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5562d71c4021] 2020-01-26T15:24:54.177 INFO:tasks.ceph.mds.a.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8bdda88175] 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: 16: (()+0x76db) [0x7f8bdd3426db] 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: 17: (clone()+0x3f) [0x7f8bdc52888f] 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: -462> 2020-01-26T15:24:28.590+0000 7f8bd8960700 -1 --2- 172.21.15.129:0/2813754503 >> v2:172.21.15.129:6790/0 conn(0x5562d9391200 0x5562da002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: -322> 2020-01-26T15:24:28.598+0000 7f8bd9962700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: 0> 2020-01-26T15:24:54.170+0000 7f8bd014f700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:54.178 INFO:tasks.ceph.mds.a.smithi129.stderr: in thread 7f8bd014f700 thread_name:MR_Finisher 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 1: (()+0x12890) [0x7f8bdd34d890] 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8bdc445e97] 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 3: (abort()+0x141) [0x7f8bdc447801] 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 4: (()+0x8c957) [0x7f8bdce3a957] 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 5: (()+0x92ab6) [0x7f8bdce40ab6] 2020-01-26T15:24:54.179 INFO:tasks.ceph.mds.a.smithi129.stderr: 6: (()+0x92af1) [0x7f8bdce40af1] 2020-01-26T15:24:54.180 INFO:tasks.ceph.mds.a.smithi129.stderr: 7: (()+0x92d24) [0x7f8bdce40d24] 2020-01-26T15:24:54.180 INFO:tasks.ceph.mds.a.smithi129.stderr: 8: (()+0x26a540) [0x7f8bdda34540] 2020-01-26T15:24:54.180 INFO:tasks.ceph.mds.a.smithi129.stderr: 9: (()+0x57ff67) [0x7f8bddd49f67] 2020-01-26T15:24:54.180 INFO:tasks.ceph.mds.a.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5562d71bd45d] 2020-01-26T15:24:54.180 INFO:tasks.ceph.mds.a.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5562d71bddf6] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5562d71bb28c] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5562d71c3d42] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5562d71c4021] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8bdda88175] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 16: (()+0x76db) [0x7f8bdd3426db] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 17: (clone()+0x3f) [0x7f8bdc52888f] 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:54.181 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: -466> 2020-01-26T15:24:28.590+0000 7f8bd8960700 -1 --2- 172.21.15.129:0/2813754503 >> v2:172.21.15.129:6790/0 conn(0x5562d9391200 0x5562da002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: -326> 2020-01-26T15:24:28.598+0000 7f8bd9962700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: -4> 2020-01-26T15:24:54.170+0000 7f8bd014f700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: in thread 7f8bd014f700 thread_name:MR_Finisher 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: 1: (()+0x12890) [0x7f8bdd34d890] 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f8bdc445e97] 2020-01-26T15:24:54.182 INFO:tasks.ceph.mds.a.smithi129.stderr: 3: (abort()+0x141) [0x7f8bdc447801] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 4: (()+0x8c957) [0x7f8bdce3a957] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 5: (()+0x92ab6) [0x7f8bdce40ab6] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 6: (()+0x92af1) [0x7f8bdce40af1] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 7: (()+0x92d24) [0x7f8bdce40d24] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 8: (()+0x26a540) [0x7f8bdda34540] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 9: (()+0x57ff67) [0x7f8bddd49f67] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x5562d71bd45d] 2020-01-26T15:24:54.183 INFO:tasks.ceph.mds.a.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x5562d71bddf6] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x5562d71bb28c] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x5562d71c3d42] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x5562d71c4021] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f8bdda88175] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 16: (()+0x76db) [0x7f8bdd3426db] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 17: (clone()+0x3f) [0x7f8bdc52888f] 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:24:54.184 INFO:tasks.ceph.mds.a.smithi129.stderr: 2020-01-26T15:24:54.215 INFO:tasks.ceph.mds.a.smithi129.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:24:55.166 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:55.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16290ec700 1 Processor -- start 2020-01-26T15:24:55.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16290ec700 1 -- start start 2020-01-26T15:24:55.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16290ec700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16240a5b80 con 0x7f1624146c30 2020-01-26T15:24:55.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16290ec700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1624080440 con 0x7f16240a5750 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16290ec700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16240a4e00 con 0x7f162414a880 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f162359e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f16240a5750 0x7f16240a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48524/0 (socket says 172.21.15.129:48524) 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f162359e700 1 -- 172.21.15.129:0/3367036179 learned_addr learned my addr 172.21.15.129:0/3367036179 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f16288eb700 1 --1- 172.21.15.129:0/3367036179 >> v1:172.21.15.129:6791/0 conn(0x7f162414a880 0x7f162414ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46144/0 (socket says 172.21.15.129:46144) 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334790779 0 0) 0x7f1624080440 con 0x7f16240a5750 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1610003230 con 0x7f16240a5750 2020-01-26T15:24:55.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989657081 0 0) 0x7f16240a4e00 con 0x7f162414a880 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1624080440 con 0x7f162414a880 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458869159 0 0) 0x7f16240a5b80 con 0x7f1624146c30 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16240a4e00 con 0x7f1624146c30 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1162739781 0 0) 0x7f1610003230 con 0x7f16240a5750 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 >> v1:172.21.15.129:6791/0 conn(0x7f162414a880 legacy=0x7f162414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 >> v1:172.21.15.129:6789/0 conn(0x7f1624146c30 legacy=0x7f1624149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:55.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240a3210 con 0x7f16240a5750 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.282+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1614001710 con 0x7f16240a5750 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1614001910 con 0x7f16240a5750 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f1622d9d700 1 -- 172.21.15.129:0/3367036179 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f16140045b0 con 0x7f16240a5750 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- 172.21.15.129:0/3367036179 >> v1:172.21.15.129:6790/0 conn(0x7f16240a5750 legacy=0x7f16240a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- 172.21.15.129:0/3367036179 shutdown_connections 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- 172.21.15.129:0/3367036179 >> 172.21.15.129:0/3367036179 conn(0x7f162405e050 msgr2=0x7f1624098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:55.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- 172.21.15.129:0/3367036179 shutdown_connections 2020-01-26T15:24:55.292 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- 172.21.15.129:0/3367036179 wait complete. 2020-01-26T15:24:55.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 Processor -- start 2020-01-26T15:24:55.294 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.286+0000 7f16290ec700 1 -- start start 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 0x7f1624065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 0x7f162413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1624066220 con 0x7f16240613a0 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1624093a20 con 0x7f162412f800 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1624062280 con 0x7f1624094b60 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f162359e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 0x7f1624065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:55.295 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f162359e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 0x7f1624065a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16288eb700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 0x7f162413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16288eb700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 0x7f162413ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f161bfff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f16240613a0 0x7f162412f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46150/0 (socket says 172.21.15.129:46150) 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f161bfff700 1 -- 172.21.15.129:0/1307415120 learned_addr learned my addr 172.21.15.129:0/1307415120 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965821977 0 0) 0x7f1624066220 con 0x7f16240613a0 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1608003230 con 0x7f16240613a0 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1209246931 0 0) 0x7f1608003230 con 0x7f16240613a0 2020-01-26T15:24:55.296 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1624066220 con 0x7f16240613a0 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f160c002860 con 0x7f16240613a0 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1593507484 0 0) 0x7f1624066220 con 0x7f16240613a0 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 msgr2=0x7f1624065a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 --2- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 0x7f1624065a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 msgr2=0x7f162413ae90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 --2- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 0x7f162413ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:55.297 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240617d0 con 0x7f16240613a0 2020-01-26T15:24:55.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1624094500 con 0x7f16240613a0 2020-01-26T15:24:55.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f162407fb90 con 0x7f16240613a0 2020-01-26T15:24:55.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f160c002cd0 con 0x7f16240613a0 2020-01-26T15:24:55.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.290+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f160c001450 con 0x7f16240613a0 2020-01-26T15:24:55.298 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.294+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1624056600 con 0x7f16240613a0 2020-01-26T15:24:55.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.294+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f160c001650 con 0x7f16240613a0 2020-01-26T15:24:55.299 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.294+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 2239717864 0 0) 0x7f160c04b9d0 con 0x7f16240613a0 2020-01-26T15:24:55.300 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.298+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f162407fb90 con 0x7f16240613a0 2020-01-26T15:24:55.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f162405cc60 con 0x7f16240613a0 2020-01-26T15:24:55.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f1620d99700 1 -- 172.21.15.129:0/1307415120 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f160c030f20 con 0x7f16240613a0 2020-01-26T15:24:55.452 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:55.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 >> v1:172.21.15.129:6800/16899 conn(0x7f160803e0a0 legacy=0x7f16080405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:55.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 >> v1:172.21.15.129:6791/0 conn(0x7f16240613a0 legacy=0x7f162412f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:55.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 shutdown_connections 2020-01-26T15:24:55.454 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 --2- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6790/0 conn(0x7f162412f800 0x7f162413ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:55.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 --2- 172.21.15.129:0/1307415120 >> v2:172.21.15.129:6791/0 conn(0x7f1624094b60 0x7f1624065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:55.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 >> 172.21.15.129:0/1307415120 conn(0x7f16240a4110 msgr2=0x7f162407e200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:55.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 shutdown_connections 2020-01-26T15:24:55.455 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:55.450+0000 7f16290ec700 1 -- 172.21.15.129:0/1307415120 wait complete. 2020-01-26T15:24:55.466 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:24:58.467 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:24:58.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56861700 1 Processor -- start 2020-01-26T15:24:58.589 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56861700 1 -- start start 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56861700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5005ea20 con 0x7fad5005e5f0 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56861700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad50098000 con 0x7fad500a6870 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56861700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5005e050 con 0x7fad5005edd0 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad57ac3700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fad500a6870 0x7fad5014c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48542/0 (socket says 172.21.15.129:48542) 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad57ac3700 1 -- 172.21.15.129:0/1591956593 learned_addr learned my addr 172.21.15.129:0/1591956593 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad5585f700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fad5005e5f0 0x7fad50149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40240/0 (socket says 172.21.15.129:40240) 2020-01-26T15:24:58.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad56060700 1 --1- 172.21.15.129:0/1591956593 >> v1:172.21.15.129:6791/0 conn(0x7fad5005edd0 0x7fad5007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46154/0 (socket says 172.21.15.129:46154) 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.582+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531014716 0 0) 0x7fad50098000 con 0x7fad500a6870 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003230 con 0x7fad500a6870 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144410493 0 0) 0x7fad5005ea20 con 0x7fad5005e5f0 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad50098000 con 0x7fad5005e5f0 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898601297 0 0) 0x7fad5005e050 con 0x7fad5005edd0 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5005ea20 con 0x7fad5005edd0 2020-01-26T15:24:58.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2161212299 0 0) 0x7fad3c003230 con 0x7fad500a6870 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 >> v1:172.21.15.129:6791/0 conn(0x7fad5005edd0 legacy=0x7fad5007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 >> v1:172.21.15.129:6789/0 conn(0x7fad5005e5f0 legacy=0x7fad50149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500a6ca0 con 0x7fad500a6870 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fad48001a90 con 0x7fad500a6870 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad48001c90 con 0x7fad500a6870 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad5505e700 1 -- 172.21.15.129:0/1591956593 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fad48004930 con 0x7fad500a6870 2020-01-26T15:24:58.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- 172.21.15.129:0/1591956593 >> v1:172.21.15.129:6790/0 conn(0x7fad500a6870 legacy=0x7fad5014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- 172.21.15.129:0/1591956593 shutdown_connections 2020-01-26T15:24:58.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- 172.21.15.129:0/1591956593 >> 172.21.15.129:0/1591956593 conn(0x7fad50098e70 msgr2=0x7fad500a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:58.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- 172.21.15.129:0/1591956593 shutdown_connections 2020-01-26T15:24:58.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- 172.21.15.129:0/1591956593 wait complete. 2020-01-26T15:24:58.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 Processor -- start 2020-01-26T15:24:58.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.586+0000 7fad56861700 1 -- start start 2020-01-26T15:24:58.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fad5009ecb0 0x7fad5009f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:58.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad500a19c0 con 0x7fad500a0170 2020-01-26T15:24:58.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5009fa60 con 0x7fad5009f630 2020-01-26T15:24:58.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fad50123ac0 con 0x7fad5009ecb0 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fad5009ecb0 0x7fad5009f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fad5009ecb0 0x7fad5009f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad57ac3700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fad5009f630 0x7fad50138c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46164/0 (socket says 172.21.15.129:46164) 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56060700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fad500a0170 0x7fad500a07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40246/0 (socket says 172.21.15.129:40246) 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad57ac3700 1 -- 172.21.15.129:0/2869523241 learned_addr learned my addr 172.21.15.129:0/2869523241 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949287117 0 0) 0x7fad500a19c0 con 0x7fad500a0170 2020-01-26T15:24:58.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad38003230 con 0x7fad500a0170 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255484359 0 0) 0x7fad5009fa60 con 0x7fad5009f630 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad500a19c0 con 0x7fad5009f630 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 453459549 0 0) 0x7fad38003230 con 0x7fad500a0170 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad5009fa60 con 0x7fad500a0170 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fad4c001850 con 0x7fad500a0170 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 >> v2:172.21.15.129:6791/0 conn(0x7fad5009ecb0 msgr2=0x7fad5009f0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 --2- 172.21.15.129:0/2869523241 >> v2:172.21.15.129:6791/0 conn(0x7fad5009ecb0 0x7fad5009f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:58.600 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 >> v1:172.21.15.129:6791/0 conn(0x7fad5009f630 legacy=0x7fad50138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 >> v1:172.21.15.129:6789/0 conn(0x7fad500a0170 legacy=0x7fad500a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fad38003230 con 0x7fad3800a7f0 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fad3800f450 con 0x7fad38003c30 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50123ac0 con 0x7fad38004080 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841799335 0 0) 0x7fad3800f450 con 0x7fad38003c30 2020-01-26T15:24:58.601 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 -- 172.21.15.129:0/2869523241 >> v1:172.21.15.129:6791/0 conn(0x7fad38003c30 legacy=0x7fad380045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 -- 172.21.15.129:0/2869523241 >> v1:172.21.15.129:6790/0 conn(0x7fad3800a7f0 legacy=0x7fad3800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad500a0ff0 con 0x7fad38004080 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500a1570 con 0x7fad38004080 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:24:58.602 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad501229d0 con 0x7fad38004080 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fad4000f320 con 0x7fad38004080 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad400112d0 con 0x7fad38004080 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.603 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fad40011670 con 0x7fad38004080 2020-01-26T15:24:58.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fad400118c0 con 0x7fad38004080 2020-01-26T15:24:58.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.590+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.594+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (secure 0 0 0) 0x7fad4004ce10 con 0x7fad38004080 2020-01-26T15:24:58.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.594+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c003360 con 0x7fad38004080 2020-01-26T15:24:58.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.598+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.605 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.598+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fad40032f60 con 0x7fad38004080 2020-01-26T15:24:58.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fad2c003790 con 0x7fad38004080 2020-01-26T15:24:58.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad5585f700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:24:58.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad46ffd700 1 -- 172.21.15.129:0/2869523241 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fad400331c0 con 0x7fad38004080 2020-01-26T15:24:58.756 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:24:58.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 >> v1:172.21.15.129:6800/16899 conn(0x7fad38048180 legacy=0x7fad3804a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad57ac3700 1 -- 172.21.15.129:0/2869523241 reap_dead start 2020-01-26T15:24:58.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 msgr2=0x7fad38004dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:24:58.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7fad400010f0 tx=0x7fad40010980).stop 2020-01-26T15:24:58.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 shutdown_connections 2020-01-26T15:24:58.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 --2- 172.21.15.129:0/2869523241 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fad38004080 0x7fad38004dc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:24:58.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 >> 172.21.15.129:0/2869523241 conn(0x7fad5005e5f0 msgr2=0x7fad5007e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:24:58.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 shutdown_connections 2020-01-26T15:24:58.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:24:58.754+0000 7fad56861700 1 -- 172.21.15.129:0/2869523241 wait complete. 2020-01-26T15:24:58.769 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:01.770 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:01.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5a4a700 1 Processor -- start 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5a4a700 1 -- start start 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5a4a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e005ea20 con 0x7f55e005e5f0 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5a4a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e0098000 con 0x7f55e005edd0 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5a4a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e005e050 con 0x7f55e00a6870 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5249700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f55e005edd0 0x7f55e007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48558/0 (socket says 172.21.15.129:48558) 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e5249700 1 -- 172.21.15.129:0/882538008 learned_addr learned my addr 172.21.15.129:0/882538008 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:01.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55e6cac700 1 --1- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6791/0 conn(0x7f55e00a6870 0x7f55e014c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46176/0 (socket says 172.21.15.129:46176) 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32851642 0 0) 0x7f55e005ea20 con 0x7f55e005e5f0 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc003230 con 0x7f55e005e5f0 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015370161 0 0) 0x7f55e0098000 con 0x7f55e005edd0 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e005ea20 con 0x7f55e005edd0 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946998417 0 0) 0x7f55e005e050 con 0x7f55e00a6870 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e0098000 con 0x7f55e00a6870 2020-01-26T15:25:01.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1634928414 0 0) 0x7f55cc003230 con 0x7f55e005e5f0 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6791/0 conn(0x7f55e00a6870 legacy=0x7f55e014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6790/0 conn(0x7f55e005edd0 legacy=0x7f55e007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e00a6ca0 con 0x7f55e005e5f0 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.882+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f55d0001640 con 0x7f55e005e5f0 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6789/0 conn(0x7f55e005e5f0 legacy=0x7f55e0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:01.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f55cc003230 con 0x7f55cc00ad40 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f55e005e050 con 0x7f55cc004d80 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0051d0 con 0x7f55cc003d40 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549734136 0 0) 0x7f55e005e050 con 0x7f55cc004d80 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc00e990 con 0x7f55cc004d80 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367572050 0 0) 0x7f55cc003230 con 0x7f55cc00ad40 2020-01-26T15:25:01.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e005e050 con 0x7f55cc00ad40 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 -- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6791/0 conn(0x7f55cc004d80 legacy=0x7f55cc003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1260759904 0 0) 0x7f55cc00e990 con 0x7f55cc004d80 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 -- 172.21.15.129:0/882538008 >> v1:172.21.15.129:6790/0 conn(0x7f55cc00ad40 legacy=0x7f55cc00d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 -- 172.21.15.129:0/882538008 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0109b0 con 0x7f55cc003d40 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f55dc0019d0 tx=0x7f55d0050010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f55dc0019d0 tx=0x7f55d0050010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f55dc0019d0 tx=0x7f55d0050010).ready entity=mon.0 client_cookie=69e66a5f850e66d server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:01.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f55dc0019d0 tx=0x7f55d0050010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f55dc001bc0 con 0x7f55cc003d40 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f55dc0019d0 tx=0x7f55d0050010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e4a48700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f55dc0019d0 tx=0x7f55d0050010).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0052a50 con 0x7f55cc003d40 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55d7fff700 1 -- 172.21.15.129:0/882538008 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f55d00553c0 con 0x7f55cc003d40 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 -- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 msgr2=0x7f55cc00a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:01.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f55dc0019d0 tx=0x7f55d0050010).stop 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 -- 172.21.15.129:0/882538008 shutdown_connections 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 --2- 172.21.15.129:0/882538008 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f55cc003d40 0x7f55cc00a7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 -- 172.21.15.129:0/882538008 >> 172.21.15.129:0/882538008 conn(0x7f55e0098e70 msgr2=0x7f55e00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 -- 172.21.15.129:0/882538008 shutdown_connections 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.886+0000 7f55e5a4a700 1 -- 172.21.15.129:0/882538008 wait complete. 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 Processor -- start 2020-01-26T15:25:01.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- start start 2020-01-26T15:25:01.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 0x7f55e007cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:01.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 0x7f55e013ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:01.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e011efd0 con 0x7f55e011eba0 2020-01-26T15:25:01.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f55e011e030 con 0x7f55e01387e0 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f55e0122b10 con 0x7f55e0122370 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e4a48700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 0x7f55e007cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e4a48700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 0x7f55e007cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e6cac700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 0x7f55e013ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5249700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f55e011eba0 0x7f55e007c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46186/0 (socket says 172.21.15.129:46186) 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5249700 1 -- 172.21.15.129:0/2900328890 learned_addr learned my addr 172.21.15.129:0/2900328890 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:01.901 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e6cac700 1 --2- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 0x7f55e013ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824494945 0 0) 0x7f55e011efd0 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003230 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2407416395 0 0) 0x7f55c0003230 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55e011efd0 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f55dc004870 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2625889844 0 0) 0x7f55e011efd0 con 0x7f55e011eba0 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 msgr2=0x7f55e007cf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:01.902 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 --2- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 0x7f55e007cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 msgr2=0x7f55e013ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 --2- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 0x7f55e013ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e007d4e0 con 0x7f55e011eba0 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0123250 con 0x7f55e011eba0 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e01227a0 con 0x7f55e011eba0 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f55dc004e20 con 0x7f55e011eba0 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f55dc005240 con 0x7f55e011eba0 2020-01-26T15:25:01.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.890+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f55dc0054c0 con 0x7f55e011eba0 2020-01-26T15:25:01.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.894+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 2239717864 0 0) 0x7f55dc04c200 con 0x7f55e011eba0 2020-01-26T15:25:01.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.894+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0056600 con 0x7f55e011eba0 2020-01-26T15:25:01.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:01.898+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f55dc0316f0 con 0x7f55e011eba0 2020-01-26T15:25:02.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55e009e3a0 con 0x7f55e011eba0 2020-01-26T15:25:02.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55d5ffb700 1 -- 172.21.15.129:0/2900328890 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f55dc04ae40 con 0x7f55e011eba0 2020-01-26T15:25:02.056 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:02.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 >> v1:172.21.15.129:6800/16899 conn(0x7f55c003e0a0 legacy=0x7f55c00405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:02.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 >> v1:172.21.15.129:6791/0 conn(0x7f55e011eba0 legacy=0x7f55e007c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:02.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 shutdown_connections 2020-01-26T15:25:02.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 --2- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6790/0 conn(0x7f55e01387e0 0x7f55e013ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:02.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 --2- 172.21.15.129:0/2900328890 >> v2:172.21.15.129:6791/0 conn(0x7f55e0122370 0x7f55e007cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:02.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 >> 172.21.15.129:0/2900328890 conn(0x7f55e0123f80 msgr2=0x7f55e007f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:02.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 shutdown_connections 2020-01-26T15:25:02.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:02.054+0000 7f55e5a4a700 1 -- 172.21.15.129:0/2900328890 wait complete. 2020-01-26T15:25:02.074 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:05.075 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:05.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.182+0000 7fbb6aa19700 1 Processor -- start 2020-01-26T15:25:05.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.182+0000 7fbb6aa19700 1 -- start start 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 0x7fbb640a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 0x7fbb6414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640a6dc0 con 0x7fbb6405edd0 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6405ea20 con 0x7fbb6405e5f0 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbb64098000 con 0x7fbb64149040 2020-01-26T15:25:05.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69a17700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 0x7fbb640a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6a218700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbb6405edd0 0x7fbb6407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46194/0 (socket says 172.21.15.129:46194) 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6a218700 1 -- 172.21.15.129:0/2926440682 learned_addr learned my addr 172.21.15.129:0/2926440682 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69a17700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 0x7fbb640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6bc7b700 -1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 0x7fbb6414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 0x7fbb6414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587170782 0 0) 0x7fbb640a6dc0 con 0x7fbb6405edd0 2020-01-26T15:25:05.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4c003230 con 0x7fbb6405edd0 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 690212083 0 0) 0x7fbb4c003230 con 0x7fbb6405edd0 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 msgr2=0x7fbb6414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 0x7fbb6414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 msgr2=0x7fbb640a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 0x7fbb640a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:05.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6405e050 con 0x7fbb6405edd0 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbb5c001a90 con 0x7fbb6405edd0 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbb5c001e20 con 0x7fbb6405edd0 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb69216700 1 -- 172.21.15.129:0/2926440682 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbb5c004ae0 con 0x7fbb6405edd0 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2926440682 >> v1:172.21.15.129:6791/0 conn(0x7fbb6405edd0 legacy=0x7fbb6407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2926440682 shutdown_connections 2020-01-26T15:25:05.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6791/0 conn(0x7fbb64149040 0x7fbb6414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:05.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 --2- 172.21.15.129:0/2926440682 >> v2:172.21.15.129:6790/0 conn(0x7fbb6405e5f0 0x7fbb640a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:05.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2926440682 >> 172.21.15.129:0/2926440682 conn(0x7fbb64098e70 msgr2=0x7fbb640a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:05.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2926440682 shutdown_connections 2020-01-26T15:25:05.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.186+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2926440682 wait complete. 2020-01-26T15:25:05.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 Processor -- start 2020-01-26T15:25:05.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- start start 2020-01-26T15:25:05.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbb64060e30 0x7fbb64060640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:05.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64133a40 con 0x7fbb640a2270 2020-01-26T15:25:05.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb64025460 con 0x7fbb6407ea00 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6409e280 con 0x7fbb64060e30 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6a218700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fbb640a2270 0x7fbb64133240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40284/0 (socket says 172.21.15.129:40284) 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6a218700 1 -- 172.21.15.129:0/2449090881 learned_addr learned my addr 172.21.15.129:0/2449090881 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb69a17700 -1 --2- 172.21.15.129:0/2449090881 >> v2:172.21.15.129:6791/0 conn(0x7fbb64060e30 0x7fbb64060640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb69a17700 1 --2- 172.21.15.129:0/2449090881 >> v2:172.21.15.129:6791/0 conn(0x7fbb64060e30 0x7fbb64060640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072958411 0 0) 0x7fbb64133a40 con 0x7fbb640a2270 2020-01-26T15:25:05.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb44003230 con 0x7fbb640a2270 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848741193 0 0) 0x7fbb64025460 con 0x7fbb6407ea00 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb64133a40 con 0x7fbb6407ea00 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 665931639 0 0) 0x7fbb44003230 con 0x7fbb640a2270 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb64025460 con 0x7fbb640a2270 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbb5c0017a0 con 0x7fbb640a2270 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 >> v2:172.21.15.129:6791/0 conn(0x7fbb64060e30 msgr2=0x7fbb64060640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:05.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 --2- 172.21.15.129:0/2449090881 >> v2:172.21.15.129:6791/0 conn(0x7fbb64060e30 0x7fbb64060640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:05.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 >> v1:172.21.15.129:6791/0 conn(0x7fbb6407ea00 legacy=0x7fbb6407ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 >> v1:172.21.15.129:6789/0 conn(0x7fbb640a2270 legacy=0x7fbb64133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:05.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbb64133a40 con 0x7fbb44004c90 2020-01-26T15:25:05.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbb44003230 con 0x7fbb44005150 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6409e280 con 0x7fbb44003da0 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450548091 0 0) 0x7fbb64133a40 con 0x7fbb44004c90 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb4400e560 con 0x7fbb44004c90 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130083876 0 0) 0x7fbb44003230 con 0x7fbb44005150 2020-01-26T15:25:05.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb64133a40 con 0x7fbb44005150 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 -- 172.21.15.129:0/2449090881 >> v1:172.21.15.129:6791/0 conn(0x7fbb44005150 legacy=0x7fbb4400a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 -- 172.21.15.129:0/2449090881 >> v1:172.21.15.129:6790/0 conn(0x7fbb44004c90 legacy=0x7fbb44003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 112004163 0 0) 0x7fbb4400e560 con 0x7fbb44004c90 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6407f630 con 0x7fbb44003da0 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6407ea00 con 0x7fbb44003da0 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6407efb0 con 0x7fbb44003da0 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbb5c001b90 con 0x7fbb44003da0 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5400c8b0 con 0x7fbb44003da0 2020-01-26T15:25:05.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.190+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbb5400ccd0 con 0x7fbb44003da0 2020-01-26T15:25:05.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.194+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb40003360 con 0x7fbb44003da0 2020-01-26T15:25:05.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.194+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.194+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fbb5400e160 con 0x7fbb44003da0 2020-01-26T15:25:05.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.194+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.194+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (secure 0 0 0) 0x7fbb5404d350 con 0x7fbb44003da0 2020-01-26T15:25:05.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.198+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.198+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fbb540334e0 con 0x7fbb44003da0 2020-01-26T15:25:05.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.354+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb40003790 con 0x7fbb44003da0 2020-01-26T15:25:05.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.354+0000 7fbb6bc7b700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:05.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.354+0000 7fbb62ffd700 1 -- 172.21.15.129:0/2449090881 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fbb54033740 con 0x7fbb44003da0 2020-01-26T15:25:05.357 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.354+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 >> v1:172.21.15.129:6800/16899 conn(0x7fbb44048210 legacy=0x7fbb4404a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 msgr2=0x7fbb4400e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:05.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 --2- 172.21.15.129:0/2449090881 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbb44003da0 0x7fbb4400e010 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fbb5c0019a0 tx=0x7fbb5c004c60).stop 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6bc7b700 1 -- 172.21.15.129:0/2449090881 reap_dead start 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6bc7b700 1 -- 172.21.15.129:0/2449090881 reap_dead start 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 shutdown_connections 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 >> 172.21.15.129:0/2449090881 conn(0x7fbb640a4be0 msgr2=0x7fbb64122880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 shutdown_connections 2020-01-26T15:25:05.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:05.358+0000 7fbb6aa19700 1 -- 172.21.15.129:0/2449090881 wait complete. 2020-01-26T15:25:05.370 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:08.371 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:08.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 Processor -- start 2020-01-26T15:25:08.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 -- start start 2020-01-26T15:25:08.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 0x7fd1c414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:08.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c405ea20 con 0x7fd1c405edd0 2020-01-26T15:25:08.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c4098000 con 0x7fd1c405e5f0 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c8949700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c405e050 con 0x7fd1c40a6870 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c3fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fd1c405edd0 0x7fd1c407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48598/0 (socket says 172.21.15.129:48598) 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c9bab700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 0x7fd1c414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c3fff700 1 -- 172.21.15.129:0/259338625 learned_addr learned my addr 172.21.15.129:0/259338625 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1bb7fe700 1 --1- 172.21.15.129:0/259338625 >> v1:172.21.15.129:6791/0 conn(0x7fd1c405e5f0 0x7fd1c4149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46216/0 (socket says 172.21.15.129:46216) 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.490+0000 7fd1c9bab700 1 --2- 172.21.15.129:0/259338625 >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 0x7fd1c414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:08.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274899375 0 0) 0x7fd1c405ea20 con 0x7fd1c405edd0 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b0003230 con 0x7fd1c405edd0 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221761864 0 0) 0x7fd1c4098000 con 0x7fd1c405e5f0 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c405ea20 con 0x7fd1c405e5f0 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 561949641 0 0) 0x7fd1b0003230 con 0x7fd1c405edd0 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 msgr2=0x7fd1c414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 --2- 172.21.15.129:0/259338625 >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 0x7fd1c414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:08.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 >> v1:172.21.15.129:6791/0 conn(0x7fd1c405e5f0 legacy=0x7fd1c4149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40a6ca0 con 0x7fd1c405edd0 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd1b4001710 con 0x7fd1c405edd0 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd1b40019e0 con 0x7fd1c405edd0 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c37fe700 1 -- 172.21.15.129:0/259338625 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd1b40045b0 con 0x7fd1c405edd0 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 -- 172.21.15.129:0/259338625 >> v1:172.21.15.129:6790/0 conn(0x7fd1c405edd0 legacy=0x7fd1c407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 -- 172.21.15.129:0/259338625 shutdown_connections 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 --2- 172.21.15.129:0/259338625 >> v2:172.21.15.129:6790/0 conn(0x7fd1c40a6870 0x7fd1c414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:08.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 -- 172.21.15.129:0/259338625 >> 172.21.15.129:0/259338625 conn(0x7fd1c4098e70 msgr2=0x7fd1c40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:08.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 -- 172.21.15.129:0/259338625 shutdown_connections 2020-01-26T15:25:08.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.494+0000 7fd1c8949700 1 -- 172.21.15.129:0/259338625 wait complete. 2020-01-26T15:25:08.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 Processor -- start 2020-01-26T15:25:08.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- start start 2020-01-26T15:25:08.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 0x7fd1c409e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:08.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 0x7fd1c411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c411f1c0 con 0x7fd1c411ed90 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40a7ec0 con 0x7fd1c4123c20 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c409c370 con 0x7fd1c409c6f0 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c3fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 0x7fd1c409e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c9bab700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fd1c411ed90 0x7fd1c407d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48608/0 (socket says 172.21.15.129:48608) 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c9bab700 1 -- 172.21.15.129:0/3270006188 learned_addr learned my addr 172.21.15.129:0/3270006188 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:08.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1bb7fe700 -1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 0x7fd1c411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c3fff700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 0x7fd1c409e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1bb7fe700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 0x7fd1c411e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283657445 0 0) 0x7fd1c411f1c0 con 0x7fd1c411ed90 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003230 con 0x7fd1c411ed90 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2019409204 0 0) 0x7fd1a8003230 con 0x7fd1c411ed90 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1c411f1c0 con 0x7fd1c411ed90 2020-01-26T15:25:08.506 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd1bc002a40 con 0x7fd1c411ed90 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 223104562 0 0) 0x7fd1c411f1c0 con 0x7fd1c411ed90 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 msgr2=0x7fd1c411e840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 0x7fd1c411e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 msgr2=0x7fd1c409e1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 0x7fd1c409e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c409e730 con 0x7fd1c411ed90 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c407dd00 con 0x7fd1c411ed90 2020-01-26T15:25:08.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c407e250 con 0x7fd1c411ed90 2020-01-26T15:25:08.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd1bc001290 con 0x7fd1c411ed90 2020-01-26T15:25:08.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.498+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd1bc001670 con 0x7fd1c411ed90 2020-01-26T15:25:08.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.502+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c003360 con 0x7fd1c411ed90 2020-01-26T15:25:08.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.502+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fd1bc0018f0 con 0x7fd1c411ed90 2020-01-26T15:25:08.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.502+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3344+0+0 (unknown 2239717864 0 0) 0x7fd1bc04be80 con 0x7fd1c411ed90 2020-01-26T15:25:08.512 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.510+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fd1bc0313b0 con 0x7fd1c411ed90 2020-01-26T15:25:08.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.670+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd19c0037d0 con 0x7fd1c411ed90 2020-01-26T15:25:08.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.670+0000 7fd1c17fa700 1 -- 172.21.15.129:0/3270006188 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fd1bc04ab00 con 0x7fd1c411ed90 2020-01-26T15:25:08.672 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:08.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 >> v1:172.21.15.129:6800/16899 conn(0x7fd1a803e070 legacy=0x7fd1a8040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:08.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 >> v1:172.21.15.129:6790/0 conn(0x7fd1c411ed90 legacy=0x7fd1c407d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:08.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 shutdown_connections 2020-01-26T15:25:08.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6790/0 conn(0x7fd1c4123c20 0x7fd1c409e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:08.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 --2- 172.21.15.129:0/3270006188 >> v2:172.21.15.129:6791/0 conn(0x7fd1c409c6f0 0x7fd1c411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:08.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 >> 172.21.15.129:0/3270006188 conn(0x7fd1c4097c50 msgr2=0x7fd1c41240b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:08.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 shutdown_connections 2020-01-26T15:25:08.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:08.674+0000 7fd1c8949700 1 -- 172.21.15.129:0/3270006188 wait complete. 2020-01-26T15:25:08.691 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:09.168 INFO:tasks.ceph.mds.b.smithi129.stderr:terminate called after throwing an instance of 'ceph::buffer::v14_2_0::end_of_buffer' 2020-01-26T15:25:09.168 INFO:tasks.ceph.mds.b.smithi129.stderr: what(): buffer::end_of_buffer 2020-01-26T15:25:09.168 INFO:tasks.ceph.mds.b.smithi129.stderr:*** Caught signal (Aborted) ** 2020-01-26T15:25:09.168 INFO:tasks.ceph.mds.b.smithi129.stderr: in thread 7f1b90b75700 thread_name:MR_Finisher 2020-01-26T15:25:09.169 INFO:tasks.ceph.mds.b.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:25:09.169 INFO:tasks.ceph.mds.b.smithi129.stderr: 1: (()+0x12890) [0x7f1b9dd73890] 2020-01-26T15:25:09.169 INFO:tasks.ceph.mds.b.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f1b9ce6be97] 2020-01-26T15:25:09.169 INFO:tasks.ceph.mds.b.smithi129.stderr: 3: (abort()+0x141) [0x7f1b9ce6d801] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 4: (()+0x8c957) [0x7f1b9d860957] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 5: (()+0x92ab6) [0x7f1b9d866ab6] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 6: (()+0x92af1) [0x7f1b9d866af1] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 7: (()+0x92d24) [0x7f1b9d866d24] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 8: (()+0x26a540) [0x7f1b9e45a540] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 9: (()+0x57ff67) [0x7f1b9e76ff67] 2020-01-26T15:25:09.170 INFO:tasks.ceph.mds.b.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x563e53ef045d] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x563e53ef0df6] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x563e53eee28c] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x563e53ef6d42] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x563e53ef7021] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f1b9e4ae175] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 16: (()+0x76db) [0x7f1b9dd686db] 2020-01-26T15:25:09.171 INFO:tasks.ceph.mds.b.smithi129.stderr: 17: (clone()+0x3f) [0x7f1b9cf4e88f] 2020-01-26T15:25:09.173 INFO:tasks.ceph.mds.b.smithi129.stderr:2020-01-26T15:25:09.166+0000 7f1b90b75700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:25:09.173 INFO:tasks.ceph.mds.b.smithi129.stderr: in thread 7f1b90b75700 thread_name:MR_Finisher 2020-01-26T15:25:09.173 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.173 INFO:tasks.ceph.mds.b.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:25:09.173 INFO:tasks.ceph.mds.b.smithi129.stderr: 1: (()+0x12890) [0x7f1b9dd73890] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f1b9ce6be97] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 3: (abort()+0x141) [0x7f1b9ce6d801] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 4: (()+0x8c957) [0x7f1b9d860957] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 5: (()+0x92ab6) [0x7f1b9d866ab6] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 6: (()+0x92af1) [0x7f1b9d866af1] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 7: (()+0x92d24) [0x7f1b9d866d24] 2020-01-26T15:25:09.174 INFO:tasks.ceph.mds.b.smithi129.stderr: 8: (()+0x26a540) [0x7f1b9e45a540] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 9: (()+0x57ff67) [0x7f1b9e76ff67] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x563e53ef045d] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x563e53ef0df6] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x563e53eee28c] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x563e53ef6d42] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x563e53ef7021] 2020-01-26T15:25:09.175 INFO:tasks.ceph.mds.b.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f1b9e4ae175] 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: 16: (()+0x76db) [0x7f1b9dd686db] 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: 17: (clone()+0x3f) [0x7f1b9cf4e88f] 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: -446> 2020-01-26T15:24:28.582+0000 7f1b99b87700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x563e564f9200 0x563e57178000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: -443> 2020-01-26T15:24:28.582+0000 7f1b9a388700 -1 --2- 172.21.15.129:0/715967792 >> v2:172.21.15.129:6790/0 conn(0x563e564f9680 0x563e57178580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: -307> 2020-01-26T15:24:28.590+0000 7f1b9a388700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:25:09.176 INFO:tasks.ceph.mds.b.smithi129.stderr: 0> 2020-01-26T15:25:09.166+0000 7f1b90b75700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: in thread 7f1b90b75700 thread_name:MR_Finisher 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 1: (()+0x12890) [0x7f1b9dd73890] 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f1b9ce6be97] 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 3: (abort()+0x141) [0x7f1b9ce6d801] 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 4: (()+0x8c957) [0x7f1b9d860957] 2020-01-26T15:25:09.177 INFO:tasks.ceph.mds.b.smithi129.stderr: 5: (()+0x92ab6) [0x7f1b9d866ab6] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 6: (()+0x92af1) [0x7f1b9d866af1] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 7: (()+0x92d24) [0x7f1b9d866d24] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 8: (()+0x26a540) [0x7f1b9e45a540] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 9: (()+0x57ff67) [0x7f1b9e76ff67] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x563e53ef045d] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x563e53ef0df6] 2020-01-26T15:25:09.178 INFO:tasks.ceph.mds.b.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x563e53eee28c] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x563e53ef6d42] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x563e53ef7021] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f1b9e4ae175] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 16: (()+0x76db) [0x7f1b9dd686db] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 17: (clone()+0x3f) [0x7f1b9cf4e88f] 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:25:09.179 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: -446> 2020-01-26T15:24:28.582+0000 7f1b99b87700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x563e564f9200 0x563e57178000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: -443> 2020-01-26T15:24:28.582+0000 7f1b9a388700 -1 --2- 172.21.15.129:0/715967792 >> v2:172.21.15.129:6790/0 conn(0x563e564f9680 0x563e57178580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: -307> 2020-01-26T15:24:28.590+0000 7f1b9a388700 -1 NetHandler create_socket couldn't create socket (97) Address family not supported by protocol 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: 0> 2020-01-26T15:25:09.166+0000 7f1b90b75700 -1 *** Caught signal (Aborted) ** 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: in thread 7f1b90b75700 thread_name:MR_Finisher 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.180 INFO:tasks.ceph.mds.b.smithi129.stderr: ceph version 15.0.0-9766-g084f050 (084f0502288c3898c3a27b35934ea510597b049d) octopus (dev) 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 1: (()+0x12890) [0x7f1b9dd73890] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 2: (gsignal()+0xc7) [0x7f1b9ce6be97] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 3: (abort()+0x141) [0x7f1b9ce6d801] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 4: (()+0x8c957) [0x7f1b9d860957] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 5: (()+0x92ab6) [0x7f1b9d866ab6] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 6: (()+0x92af1) [0x7f1b9d866af1] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 7: (()+0x92d24) [0x7f1b9d866d24] 2020-01-26T15:25:09.181 INFO:tasks.ceph.mds.b.smithi129.stderr: 8: (()+0x26a540) [0x7f1b9e45a540] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 9: (()+0x57ff67) [0x7f1b9e76ff67] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 10: (SessionMapStore::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x5d) [0x563e53ef045d] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 11: (SessionMap::decode_legacy(ceph::buffer::v14_2_0::list::iterator_impl&)+0x26) [0x563e53ef0df6] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 12: (SessionMap::_load_legacy_finish(int, ceph::buffer::v14_2_0::list&)+0x5c) [0x563e53eee28c] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 13: (MDSContext::complete(int)+0x52) [0x563e53ef6d42] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 14: (MDSIOContextBase::complete(int)+0x181) [0x563e53ef7021] 2020-01-26T15:25:09.182 INFO:tasks.ceph.mds.b.smithi129.stderr: 15: (Finisher::finisher_thread_entry()+0x195) [0x7f1b9e4ae175] 2020-01-26T15:25:09.183 INFO:tasks.ceph.mds.b.smithi129.stderr: 16: (()+0x76db) [0x7f1b9dd686db] 2020-01-26T15:25:09.183 INFO:tasks.ceph.mds.b.smithi129.stderr: 17: (clone()+0x3f) [0x7f1b9cf4e88f] 2020-01-26T15:25:09.183 INFO:tasks.ceph.mds.b.smithi129.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-01-26T15:25:09.183 INFO:tasks.ceph.mds.b.smithi129.stderr: 2020-01-26T15:25:09.224 INFO:tasks.ceph.mds.b.smithi129.stderr:daemon-helper: command crashed with signal 6 2020-01-26T15:25:11.692 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 Processor -- start 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- start start 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 0x7f8c240a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 0x7f8c2414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:11.815 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c240a6dc0 con 0x7f8c2405edd0 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2405ea20 con 0x7f8c2405e5f0 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8c24098000 con 0x7f8c24149040 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c23fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 0x7f8c240a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c28c08700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f8c2405edd0 0x7f8c2407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48618/0 (socket says 172.21.15.129:48618) 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c28c08700 1 -- 172.21.15.129:0/368731884 learned_addr learned my addr 172.21.15.129:0/368731884 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c2a66b700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 0x7f8c2414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c23fff700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 0x7f8c240a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:11.816 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 0x7f8c2414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024279772 0 0) 0x7f8c240a6dc0 con 0x7f8c2405edd0 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c10003230 con 0x7f8c2405edd0 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2750039171 0 0) 0x7f8c10003230 con 0x7f8c2405edd0 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 msgr2=0x7f8c2414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 0x7f8c2414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:11.817 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 msgr2=0x7f8c240a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 0x7f8c240a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2405e050 con 0x7f8c2405edd0 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8c14001710 con 0x7f8c2405edd0 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8c14001910 con 0x7f8c2405edd0 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c237fe700 1 -- 172.21.15.129:0/368731884 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8c140045b0 con 0x7f8c2405edd0 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- 172.21.15.129:0/368731884 >> v1:172.21.15.129:6790/0 conn(0x7f8c2405edd0 legacy=0x7f8c2407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.818 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- 172.21.15.129:0/368731884 shutdown_connections 2020-01-26T15:25:11.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6791/0 conn(0x7f8c24149040 0x7f8c2414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:11.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 --2- 172.21.15.129:0/368731884 >> v2:172.21.15.129:6790/0 conn(0x7f8c2405e5f0 0x7f8c240a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:11.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.810+0000 7f8c29409700 1 -- 172.21.15.129:0/368731884 >> 172.21.15.129:0/368731884 conn(0x7f8c24098e70 msgr2=0x7f8c240a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:11.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- 172.21.15.129:0/368731884 shutdown_connections 2020-01-26T15:25:11.819 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- 172.21.15.129:0/368731884 wait complete. 2020-01-26T15:25:11.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 Processor -- start 2020-01-26T15:25:11.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- start start 2020-01-26T15:25:11.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8c2412e840 0x7f8c2412ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8c2412f1c0 0x7f8c2413a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2412f5f0 con 0x7f8c240a3000 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2409ea00 con 0x7f8c2412f1c0 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c29409700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240a2630 con 0x7f8c2412e840 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c23fff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8c2412e840 0x7f8c2412ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c2a66b700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f8c2412f1c0 0x7f8c2413a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:11.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c28c08700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f8c240a3000 0x7f8c2409edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40324/0 (socket says 172.21.15.129:40324) 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c23fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8c2412e840 0x7f8c2412ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c28c08700 1 -- 172.21.15.129:0/3654465423 learned_addr learned my addr 172.21.15.129:0/3654465423 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> v2:172.21.15.129:6790/0 conn(0x7f8c2412f1c0 0x7f8c2413a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478552767 0 0) 0x7f8c2412f5f0 con 0x7f8c240a3000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c08003230 con 0x7f8c240a3000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3345505411 0 0) 0x7f8c08003230 con 0x7f8c240a3000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c2412f5f0 con 0x7f8c240a3000 2020-01-26T15:25:11.825 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8c14001830 con 0x7f8c240a3000 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 >> v2:172.21.15.129:6791/0 conn(0x7f8c2412e840 msgr2=0x7f8c2412ec70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 --2- 172.21.15.129:0/3654465423 >> v2:172.21.15.129:6791/0 conn(0x7f8c2412e840 0x7f8c2412ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 >> v2:172.21.15.129:6790/0 conn(0x7f8c2412f1c0 msgr2=0x7f8c2413a680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 --2- 172.21.15.129:0/3654465423 >> v2:172.21.15.129:6790/0 conn(0x7f8c2412f1c0 0x7f8c2413a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 >> v1:172.21.15.129:6789/0 conn(0x7f8c240a3000 legacy=0x7f8c2409edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:11.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c08003230 con 0x7f8c08003a20 2020-01-26T15:25:11.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.814+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8c0800f250 con 0x7f8c08003ed0 2020-01-26T15:25:11.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:11.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2409ea00 con 0x7f8c0800b800 2020-01-26T15:25:11.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833730549 0 0) 0x7f8c08003230 con 0x7f8c08003a20 2020-01-26T15:25:11.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c0800e440 con 0x7f8c08003a20 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250213669 0 0) 0x7f8c0800f250 con 0x7f8c08003ed0 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c08003230 con 0x7f8c08003ed0 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 -- 172.21.15.129:0/3654465423 >> v1:172.21.15.129:6791/0 conn(0x7f8c08003ed0 legacy=0x7f8c08004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 -- 172.21.15.129:0/3654465423 >> v1:172.21.15.129:6790/0 conn(0x7f8c08003a20 legacy=0x7f8c080045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2409f5c0 con 0x7f8c0800b800 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 -- 172.21.15.129:0/3654465423 reap_dead start 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c240a2280 con 0x7f8c0800b800 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2409e2f0 con 0x7f8c0800b800 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8c1c00e9a0 con 0x7f8c0800b800 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00eba0 con 0x7f8c0800b800 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8c1c009170 con 0x7f8c0800b800 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc003360 con 0x7f8c0800b800 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8c1c009370 con 0x7f8c0800b800 2020-01-26T15:25:11.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.818+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f8c1c04de40 con 0x7f8c0800b800 2020-01-26T15:25:11.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.826+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.826+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8c2409e2f0 con 0x7f8c0800b800 2020-01-26T15:25:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.978+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8bfc003790 con 0x7f8c0800b800 2020-01-26T15:25:11.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c2a66b700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:11.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c217fa700 1 -- 172.21.15.129:0/3654465423 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8c1c033ff0 con 0x7f8c0800b800 2020-01-26T15:25:11.983 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 >> v1:172.21.15.129:6800/16899 conn(0x7f8c08040c00 legacy=0x7f8c08043110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 msgr2=0x7f8c0800dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f8c1c0032b0 tx=0x7f8c1c010cc0).stop 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 shutdown_connections 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 --2- 172.21.15.129:0/3654465423 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8c0800b800 0x7f8c0800dc40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:11.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 >> 172.21.15.129:0/3654465423 conn(0x7f8c2405ef50 msgr2=0x7f8c241232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 shutdown_connections 2020-01-26T15:25:11.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:11.982+0000 7f8c29409700 1 -- 172.21.15.129:0/3654465423 wait complete. 2020-01-26T15:25:11.995 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:14.996 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:15.120 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 Processor -- start 2020-01-26T15:25:15.120 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 -- start start 2020-01-26T15:25:15.120 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 0x7f4ba405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:15.120 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba4098000 con 0x7f4ba40a6870 2020-01-26T15:25:15.120 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba405e050 con 0x7f4ba4149040 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba40a6ca0 con 0x7f4ba405edd0 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4bab42a700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f4ba4149040 0x7f4ba414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46256/0 (socket says 172.21.15.129:46256) 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4bab42a700 1 -- 172.21.15.129:0/113382671 learned_addr learned my addr 172.21.15.129:0/113382671 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba99c7700 -1 --2- 172.21.15.129:0/113382671 >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 0x7f4ba405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/113382671 >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 0x7f4ba405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:15.121 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126298326 0 0) 0x7f4ba405e050 con 0x7f4ba4149040 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c003230 con 0x7f4ba4149040 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655523602 0 0) 0x7f4ba4098000 con 0x7f4ba40a6870 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba405e050 con 0x7f4ba40a6870 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1644153577 0 0) 0x7f4b8c003230 con 0x7f4ba4149040 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 msgr2=0x7f4ba405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:15.122 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 --2- 172.21.15.129:0/113382671 >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 0x7f4ba405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 >> v1:172.21.15.129:6789/0 conn(0x7f4ba40a6870 legacy=0x7f4ba407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba414ecb0 con 0x7f4ba4149040 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4b9c001710 con 0x7f4ba4149040 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4b9c0019e0 con 0x7f4ba4149040 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4baa1c8700 1 -- 172.21.15.129:0/113382671 >> v1:172.21.15.129:6791/0 conn(0x7f4ba4149040 legacy=0x7f4ba414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.114+0000 7f4ba89c5700 1 -- 172.21.15.129:0/113382671 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4b9c0045b0 con 0x7f4ba4149040 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- 172.21.15.129:0/113382671 shutdown_connections 2020-01-26T15:25:15.123 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 --2- 172.21.15.129:0/113382671 >> v2:172.21.15.129:6790/0 conn(0x7f4ba405edd0 0x7f4ba405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:15.124 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- 172.21.15.129:0/113382671 >> 172.21.15.129:0/113382671 conn(0x7f4ba4098e70 msgr2=0x7f4ba40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:15.124 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- 172.21.15.129:0/113382671 shutdown_connections 2020-01-26T15:25:15.124 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- 172.21.15.129:0/113382671 wait complete. 2020-01-26T15:25:15.128 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 Processor -- start 2020-01-26T15:25:15.128 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- start start 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4ba40a1340 0x7f4ba4122280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba407d670 con 0x7f4ba41227d0 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba407c830 con 0x7f4ba40a1770 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4baa1c8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba407d1c0 con 0x7f4ba40a1340 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4bab42a700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4ba41227d0 0x7f4ba407a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40344/0 (socket says 172.21.15.129:40344) 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4bab42a700 1 -- 172.21.15.129:0/158514229 learned_addr learned my addr 172.21.15.129:0/158514229 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:15.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba99c7700 -1 --2- 172.21.15.129:0/158514229 >> v2:172.21.15.129:6790/0 conn(0x7f4ba40a1340 0x7f4ba4122280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> v2:172.21.15.129:6790/0 conn(0x7f4ba40a1340 0x7f4ba4122280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226775628 0 0) 0x7f4ba407d670 con 0x7f4ba41227d0 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003230 con 0x7f4ba41227d0 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460560346 0 0) 0x7f4ba407c830 con 0x7f4ba40a1770 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.118+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba407d670 con 0x7f4ba40a1770 2020-01-26T15:25:15.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3120018303 0 0) 0x7f4b84003230 con 0x7f4ba41227d0 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ba407c830 con 0x7f4ba41227d0 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4b9c001420 con 0x7f4ba41227d0 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 >> v2:172.21.15.129:6790/0 conn(0x7f4ba40a1340 msgr2=0x7f4ba4122280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 --2- 172.21.15.129:0/158514229 >> v2:172.21.15.129:6790/0 conn(0x7f4ba40a1340 0x7f4ba4122280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 >> v1:172.21.15.129:6790/0 conn(0x7f4ba40a1770 legacy=0x7f4ba40799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 >> v1:172.21.15.129:6789/0 conn(0x7f4ba41227d0 legacy=0x7f4ba407a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.131 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4b84003230 con 0x7f4b8400a7f0 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4b8400f450 con 0x7f4b840040c0 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba407d1c0 con 0x7f4b84003c30 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800107055 0 0) 0x7f4b84003230 con 0x7f4b8400a7f0 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8400f680 con 0x7f4b8400a7f0 2020-01-26T15:25:15.132 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703264920 0 0) 0x7f4b8400f450 con 0x7f4b840040c0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003230 con 0x7f4b840040c0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2167124352 0 0) 0x7f4b84003230 con 0x7f4b840040c0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b8400f450 con 0x7f4b840040c0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4b98002900 con 0x7f4b840040c0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3200656761 0 0) 0x7f4b8400f680 con 0x7f4b8400a7f0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b84003230 con 0x7f4b8400a7f0 2020-01-26T15:25:15.133 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4b9c004c10 con 0x7f4b8400a7f0 2020-01-26T15:25:15.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 -- 172.21.15.129:0/158514229 >> v1:172.21.15.129:6791/0 conn(0x7f4b840040c0 legacy=0x7f4b84004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 -- 172.21.15.129:0/158514229 >> v1:172.21.15.129:6790/0 conn(0x7f4b8400a7f0 legacy=0x7f4b8400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40247b0 con 0x7f4b84003c30 2020-01-26T15:25:15.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba40a1770 con 0x7f4b84003c30 2020-01-26T15:25:15.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba40799b0 con 0x7f4b84003c30 2020-01-26T15:25:15.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:15.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4b94005da0 con 0x7f4b84003c30 2020-01-26T15:25:15.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94012450 con 0x7f4b84003c30 2020-01-26T15:25:15.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4b94012830 con 0x7f4b84003c30 2020-01-26T15:25:15.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.122+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80003360 con 0x7f4b84003c30 2020-01-26T15:25:15.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.126+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f4b94012a30 con 0x7f4b84003c30 2020-01-26T15:25:15.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.126+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.142 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.126+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f4b9404d900 con 0x7f4b84003c30 2020-01-26T15:25:15.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.130+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.143 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.130+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f4b94033d10 con 0x7f4b84003c30 2020-01-26T15:25:15.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4b80003790 con 0x7f4b84003c30 2020-01-26T15:25:15.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4ba99c7700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:15.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4ba27fc700 1 -- 172.21.15.129:0/158514229 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f4b94012d40 con 0x7f4b84003c30 2020-01-26T15:25:15.288 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:15.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 >> v1:172.21.15.129:6800/16899 conn(0x7f4b84048700 legacy=0x7f4b8404ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 msgr2=0x7f4b840045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:15.290 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4baa1c8700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4b940032b0 tx=0x7f4b98002b00).stop 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.286+0000 7f4bab42a700 1 -- 172.21.15.129:0/158514229 reap_dead start 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.290+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 shutdown_connections 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.290+0000 7f4baa1c8700 1 --2- 172.21.15.129:0/158514229 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4b84003c30 0x7f4b840045a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.290+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 >> 172.21.15.129:0/158514229 conn(0x7f4ba405f160 msgr2=0x7f4ba40a2300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.290+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 shutdown_connections 2020-01-26T15:25:15.291 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:15.290+0000 7f4baa1c8700 1 -- 172.21.15.129:0/158514229 wait complete. 2020-01-26T15:25:15.307 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:18.309 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:18.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a870700 1 Processor -- start 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a870700 1 -- start start 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a870700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814405ea20 con 0x7f814405edd0 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a870700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8144098000 con 0x7f814405e5f0 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a870700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814405e050 con 0x7f81440a6870 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a06f700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f814405edd0 0x7f814407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40360/0 (socket says 172.21.15.129:40360) 2020-01-26T15:25:18.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814986e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f814405e5f0 0x7f8144149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48662/0 (socket says 172.21.15.129:48662) 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814a06f700 1 -- 172.21.15.129:0/308154317 learned_addr learned my addr 172.21.15.129:0/308154317 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814bad2700 1 --1- 172.21.15.129:0/308154317 >> v1:172.21.15.129:6791/0 conn(0x7f81440a6870 0x7f814414c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46278/0 (socket says 172.21.15.129:46278) 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228161592 0 0) 0x7f814405e050 con 0x7f81440a6870 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f812c003230 con 0x7f81440a6870 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384339176 0 0) 0x7f8144098000 con 0x7f814405e5f0 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f814405e050 con 0x7f814405e5f0 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710656819 0 0) 0x7f814405ea20 con 0x7f814405edd0 2020-01-26T15:25:18.430 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.422+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8144098000 con 0x7f814405edd0 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 66725847 0 0) 0x7f814405e050 con 0x7f814405e5f0 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 >> v1:172.21.15.129:6791/0 conn(0x7f81440a6870 legacy=0x7f814414c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 >> v1:172.21.15.129:6789/0 conn(0x7f814405edd0 legacy=0x7f814407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440a6ca0 con 0x7f814405e5f0 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f81380016f0 con 0x7f814405e5f0 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814906d700 1 -- 172.21.15.129:0/308154317 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f81380019c0 con 0x7f814405e5f0 2020-01-26T15:25:18.431 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- 172.21.15.129:0/308154317 >> v1:172.21.15.129:6790/0 conn(0x7f814405e5f0 legacy=0x7f8144149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- 172.21.15.129:0/308154317 shutdown_connections 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- 172.21.15.129:0/308154317 >> 172.21.15.129:0/308154317 conn(0x7f8144098e70 msgr2=0x7f81440a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- 172.21.15.129:0/308154317 shutdown_connections 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- 172.21.15.129:0/308154317 wait complete. 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 Processor -- start 2020-01-26T15:25:18.432 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- start start 2020-01-26T15:25:18.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 0x7f8144099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814407e420 con 0x7f8144140c50 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814415cde0 con 0x7f8144140410 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a870700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f8144141080 con 0x7f8144143e30 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814986e700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f8144140c50 0x7f8144153740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40364/0 (socket says 172.21.15.129:40364) 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814986e700 1 -- 172.21.15.129:0/487414552 learned_addr learned my addr 172.21.15.129:0/487414552 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:18.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814bad2700 1 --1- 172.21.15.129:0/487414552 >> v1:172.21.15.129:6790/0 conn(0x7f8144140410 0x7f8144153f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48666/0 (socket says 172.21.15.129:48666) 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a06f700 -1 --2- 172.21.15.129:0/487414552 >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 0x7f8144099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f814a06f700 1 --2- 172.21.15.129:0/487414552 >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 0x7f8144099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339198391 0 0) 0x7f814415cde0 con 0x7f8144140410 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.426+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8124003230 con 0x7f8144140410 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228755485 0 0) 0x7f814407e420 con 0x7f8144140c50 2020-01-26T15:25:18.436 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f814415cde0 con 0x7f8144140c50 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 578094007 0 0) 0x7f8124003230 con 0x7f8144140410 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f814407e420 con 0x7f8144140410 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8134001910 con 0x7f8144140410 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1385207765 0 0) 0x7f814415cde0 con 0x7f8144140c50 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8124003230 con 0x7f8144140c50 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 778799537 0 0) 0x7f814407e420 con 0x7f8144140410 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 msgr2=0x7f8144099a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:18.437 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 --2- 172.21.15.129:0/487414552 >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 0x7f8144099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 >> v1:172.21.15.129:6789/0 conn(0x7f8144140c50 legacy=0x7f8144153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814407eca0 con 0x7f8144140410 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814415bdd0 con 0x7f8144140410 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f814415c2a0 con 0x7f8144140410 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f81340045f0 con 0x7f8144140410 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8134004a10 con 0x7f8144140410 2020-01-26T15:25:18.438 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8144056600 con 0x7f8144140410 2020-01-26T15:25:18.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f8134004c10 con 0x7f8144140410 2020-01-26T15:25:18.439 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.430+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f813404b8e0 con 0x7f8144140410 2020-01-26T15:25:18.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.438+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8134030e60 con 0x7f8144140410 2020-01-26T15:25:18.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81441409e0 con 0x7f8144140410 2020-01-26T15:25:18.604 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f8142ffd700 1 -- 172.21.15.129:0/487414552 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f813404a550 con 0x7f8144140410 2020-01-26T15:25:18.605 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:18.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 >> v1:172.21.15.129:6800/16899 conn(0x7f812403e440 legacy=0x7f8124040950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 >> v1:172.21.15.129:6790/0 conn(0x7f8144140410 legacy=0x7f8144153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:18.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 shutdown_connections 2020-01-26T15:25:18.606 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 --2- 172.21.15.129:0/487414552 >> v2:172.21.15.129:6791/0 conn(0x7f8144143e30 0x7f8144099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:18.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.602+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 >> 172.21.15.129:0/487414552 conn(0x7f81440a0ec0 msgr2=0x7f81440a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:18.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.606+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 shutdown_connections 2020-01-26T15:25:18.607 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:18.606+0000 7f814a870700 1 -- 172.21.15.129:0/487414552 wait complete. 2020-01-26T15:25:18.618 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:21.618 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:21.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.726+0000 7ff5fdf9d700 1 Processor -- start 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.726+0000 7ff5fdf9d700 1 -- start start 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 0x7ff5f80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80a6dc0 con 0x7ff5f8149040 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f805ea20 con 0x7ff5f805edd0 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f8098000 con 0x7ff5f805e5f0 2020-01-26T15:25:21.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fd79c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7ff5f805edd0 0x7ff5f807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46288/0 (socket says 172.21.15.129:46288) 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fd79c700 1 -- 172.21.15.129:0/2731108254 learned_addr learned my addr 172.21.15.129:0/2731108254 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5ff1ff700 1 --1- 172.21.15.129:0/2731108254 >> v1:172.21.15.129:6790/0 conn(0x7ff5f8149040 0x7ff5f814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48676/0 (socket says 172.21.15.129:48676) 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fcf9b700 -1 --2- 172.21.15.129:0/2731108254 >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 0x7ff5f80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fcf9b700 1 --2- 172.21.15.129:0/2731108254 >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 0x7ff5f80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504764111 0 0) 0x7ff5f805ea20 con 0x7ff5f805edd0 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e0003230 con 0x7ff5f805edd0 2020-01-26T15:25:21.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357463585 0 0) 0x7ff5f80a6dc0 con 0x7ff5f8149040 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f805ea20 con 0x7ff5f8149040 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2451382337 0 0) 0x7ff5e0003230 con 0x7ff5f805edd0 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 msgr2=0x7ff5f80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 --2- 172.21.15.129:0/2731108254 >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 0x7ff5f80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 >> v1:172.21.15.129:6790/0 conn(0x7ff5f8149040 legacy=0x7ff5f814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f805e050 con 0x7ff5f805edd0 2020-01-26T15:25:21.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff5e8001a90 con 0x7ff5f805edd0 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5e8001c90 con 0x7ff5f805edd0 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5f7fff700 1 -- 172.21.15.129:0/2731108254 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff5e8004930 con 0x7ff5f805edd0 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/2731108254 >> v1:172.21.15.129:6791/0 conn(0x7ff5f805edd0 legacy=0x7ff5f807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/2731108254 shutdown_connections 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 --2- 172.21.15.129:0/2731108254 >> v2:172.21.15.129:6790/0 conn(0x7ff5f805e5f0 0x7ff5f80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/2731108254 >> 172.21.15.129:0/2731108254 conn(0x7ff5f8098e70 msgr2=0x7ff5f80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:21.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/2731108254 shutdown_connections 2020-01-26T15:25:21.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.730+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/2731108254 wait complete. 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 Processor -- start 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- start start 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 0x7ff5f8131750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 0x7ff5f8138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f81320d0 con 0x7ff5f8121b10 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f8123120 con 0x7ff5f8131ca0 2020-01-26T15:25:21.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80a3c80 con 0x7ff5f8120960 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fd79c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ff5f8121b10 0x7ff5f8099e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48678/0 (socket says 172.21.15.129:48678) 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fd79c700 1 -- 172.21.15.129:0/3654961337 learned_addr learned my addr 172.21.15.129:0/3654961337 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fcf9b700 -1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 0x7ff5f8131750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5ff1ff700 -1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 0x7ff5f8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fcf9b700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 0x7ff5f8131750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5ff1ff700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 0x7ff5f8138690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:21.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515509644 0 0) 0x7ff5f81320d0 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d8003230 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1421302915 0 0) 0x7ff5d8003230 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5f81320d0 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff5e8001d60 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2529169144 0 0) 0x7ff5f81320d0 con 0x7ff5f8121b10 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 msgr2=0x7ff5f8131750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:21.742 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 0x7ff5f8131750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 msgr2=0x7ff5f8138690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 0x7ff5f8138690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f809a620 con 0x7ff5f8121b10 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f81216e0 con 0x7ff5f8121b10 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f80a1360 con 0x7ff5f8121b10 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5e8004eb0 con 0x7ff5f8121b10 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.734+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff5e8005250 con 0x7ff5f8121b10 2020-01-26T15:25:21.743 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.738+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f8056600 con 0x7ff5f8121b10 2020-01-26T15:25:21.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.738+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7ff5e8010c90 con 0x7ff5f8121b10 2020-01-26T15:25:21.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.738+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7ff5e804bf30 con 0x7ff5f8121b10 2020-01-26T15:25:21.744 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.742+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7ff5f80a1360 con 0x7ff5f8121b10 2020-01-26T15:25:21.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.898+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff5f805cc60 con 0x7ff5f8121b10 2020-01-26T15:25:21.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.898+0000 7ff5f5ffb700 1 -- 172.21.15.129:0/3654961337 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7ff5e8031510 con 0x7ff5f8121b10 2020-01-26T15:25:21.900 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 >> v1:172.21.15.129:6800/16899 conn(0x7ff5d803e0a0 legacy=0x7ff5d80405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 >> v1:172.21.15.129:6790/0 conn(0x7ff5f8121b10 legacy=0x7ff5f8099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 shutdown_connections 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6790/0 conn(0x7ff5f8131ca0 0x7ff5f8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 --2- 172.21.15.129:0/3654961337 >> v2:172.21.15.129:6791/0 conn(0x7ff5f8120960 0x7ff5f8131750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:21.903 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 >> 172.21.15.129:0/3654961337 conn(0x7ff5f805e5f0 msgr2=0x7ff5f807e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:21.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 shutdown_connections 2020-01-26T15:25:21.904 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:21.902+0000 7ff5fdf9d700 1 -- 172.21.15.129:0/3654961337 wait complete. 2020-01-26T15:25:21.917 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:24.919 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:25.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 Processor -- start 2020-01-26T15:25:25.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 -- start start 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb2740a5750 0x7fb2740a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740a5b80 con 0x7fb27405f250 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb274080440 con 0x7fb2740a4b50 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb278b8e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740a43f0 con 0x7fb2740a5750 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb27259c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fb2740a4b50 0x7fb27405ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46302/0 (socket says 172.21.15.129:46302) 2020-01-26T15:25:25.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb27259c700 1 -- 172.21.15.129:0/1373309623 learned_addr learned my addr 172.21.15.129:0/1373309623 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb272d9d700 -1 --2- 172.21.15.129:0/1373309623 >> v2:172.21.15.129:6790/0 conn(0x7fb2740a5750 0x7fb2740a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb272d9d700 1 --2- 172.21.15.129:0/1373309623 >> v2:172.21.15.129:6790/0 conn(0x7fb2740a5750 0x7fb2740a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929747460 0 0) 0x7fb2740a5b80 con 0x7fb27405f250 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb260003230 con 0x7fb27405f250 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099280147 0 0) 0x7fb274080440 con 0x7fb2740a4b50 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2740a5b80 con 0x7fb2740a4b50 2020-01-26T15:25:25.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1843121208 0 0) 0x7fb260003230 con 0x7fb27405f250 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 >> v2:172.21.15.129:6790/0 conn(0x7fb2740a5750 msgr2=0x7fb2740a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 --2- 172.21.15.129:0/1373309623 >> v2:172.21.15.129:6790/0 conn(0x7fb2740a5750 0x7fb2740a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 >> v1:172.21.15.129:6791/0 conn(0x7fb2740a4b50 legacy=0x7fb27405ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2740a3210 con 0x7fb27405f250 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb26c001710 con 0x7fb27405f250 2020-01-26T15:25:25.044 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 >> v1:172.21.15.129:6789/0 conn(0x7fb27405f250 legacy=0x7fb27414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.034+0000 7fb271d9b700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:25.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb260003230 con 0x7fb260003ac0 2020-01-26T15:25:25.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb2740a5b80 con 0x7fb260003f70 2020-01-26T15:25:25.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740a43f0 con 0x7fb26000b800 2020-01-26T15:25:25.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840788723 0 0) 0x7fb2740a5b80 con 0x7fb260003f70 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb274080440 con 0x7fb260003f70 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51478081 0 0) 0x7fb260003230 con 0x7fb260003ac0 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2740a5b80 con 0x7fb260003ac0 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 -- 172.21.15.129:0/1373309623 >> v1:172.21.15.129:6791/0 conn(0x7fb260003f70 legacy=0x7fb260004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 -- 172.21.15.129:0/1373309623 >> v1:172.21.15.129:6790/0 conn(0x7fb260003ac0 legacy=0x7fb2600045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 -- 172.21.15.129:0/1373309623 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26000e280 con 0x7fb26000b800 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb26c001520 tx=0x7fb26c00c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb26c001520 tx=0x7fb26c00c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fb26c001520 tx=0x7fb26c00c160).ready entity=mon.0 client_cookie=f83062d7009467dd server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fb26c001520 tx=0x7fb26c00c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb26c010b50 con 0x7fb26000b800 2020-01-26T15:25:25.047 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fb26c001520 tx=0x7fb26c00c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c010d50 con 0x7fb26000b800 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fb26c001520 tx=0x7fb26c00c160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb271d9b700 1 -- 172.21.15.129:0/1373309623 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb26c00c960 con 0x7fb26000b800 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 -- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 msgr2=0x7fb26000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 --2- 172.21.15.129:0/1373309623 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb26000b800 0x7fb26000dc40 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fb26c001520 tx=0x7fb26c00c160).stop 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb27359e700 1 -- 172.21.15.129:0/1373309623 reap_dead start 2020-01-26T15:25:25.048 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 -- 172.21.15.129:0/1373309623 shutdown_connections 2020-01-26T15:25:25.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 -- 172.21.15.129:0/1373309623 >> 172.21.15.129:0/1373309623 conn(0x7fb27405e050 msgr2=0x7fb274098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:25.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 -- 172.21.15.129:0/1373309623 shutdown_connections 2020-01-26T15:25:25.049 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.038+0000 7fb278b8e700 1 -- 172.21.15.129:0/1373309623 wait complete. 2020-01-26T15:25:25.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 Processor -- start 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 -- start start 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb27408f7b0 0x7fb27407cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27407d820 con 0x7fb274091400 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb274096830 con 0x7fb27407d3f0 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb278b8e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb27408fbe0 con 0x7fb27408f7b0 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb272d9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb27408f7b0 0x7fb27407cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:25.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb272d9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb27408f7b0 0x7fb27407cea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27259c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb27407d3f0 0x7fb274090c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48700/0 (socket says 172.21.15.129:48700) 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27259c700 1 -- 172.21.15.129:0/1346091471 learned_addr learned my addr 172.21.15.129:0/1346091471 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054036867 0 0) 0x7fb274096830 con 0x7fb27407d3f0 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003230 con 0x7fb27407d3f0 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176659794 0 0) 0x7fb27407d820 con 0x7fb274091400 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb274096830 con 0x7fb274091400 2020-01-26T15:25:25.055 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 584273927 0 0) 0x7fb258003230 con 0x7fb27407d3f0 2020-01-26T15:25:25.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb27407d820 con 0x7fb27407d3f0 2020-01-26T15:25:25.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb264001740 con 0x7fb27407d3f0 2020-01-26T15:25:25.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1121839574 0 0) 0x7fb274096830 con 0x7fb274091400 2020-01-26T15:25:25.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb258003230 con 0x7fb274091400 2020-01-26T15:25:25.056 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb26c00edd0 con 0x7fb274091400 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 >> v2:172.21.15.129:6791/0 conn(0x7fb27408f7b0 msgr2=0x7fb27407cea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 --2- 172.21.15.129:0/1346091471 >> v2:172.21.15.129:6791/0 conn(0x7fb27408f7b0 0x7fb27407cea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 >> v1:172.21.15.129:6790/0 conn(0x7fb27407d3f0 legacy=0x7fb274090c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 >> v1:172.21.15.129:6789/0 conn(0x7fb274091400 legacy=0x7fb2741384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb274096830 con 0x7fb258004f00 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb2580042f0 con 0x7fb258003d40 2020-01-26T15:25:25.057 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27408fbe0 con 0x7fb25800c000 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139934383 0 0) 0x7fb2580042f0 con 0x7fb258003d40 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb25800e990 con 0x7fb258003d40 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343788975 0 0) 0x7fb274096830 con 0x7fb258004f00 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2580042f0 con 0x7fb258004f00 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27359e700 1 -- 172.21.15.129:0/1346091471 >> v1:172.21.15.129:6791/0 conn(0x7fb258003d40 legacy=0x7fb25800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27359e700 1 -- 172.21.15.129:0/1346091471 >> v1:172.21.15.129:6790/0 conn(0x7fb258004f00 legacy=0x7fb258003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.042+0000 7fb27359e700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fb27408ffe0 con 0x7fb25800c000 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2740a6750 con 0x7fb25800c000 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27407d3f0 con 0x7fb25800c000 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb26c00e560 con 0x7fb25800c000 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c010160 con 0x7fb25800c000 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fb26c010350 con 0x7fb25800c000 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c003360 con 0x7fb25800c000 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.046+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fb26c04d230 con 0x7fb25800c000 2020-01-26T15:25:25.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.050+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.050+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fb26c033640 con 0x7fb25800c000 2020-01-26T15:25:25.210 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb24c003790 con 0x7fb25800c000 2020-01-26T15:25:25.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb27359e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:25.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb26b7fe700 1 -- 172.21.15.129:0/1346091471 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb26c0341f0 con 0x7fb25800c000 2020-01-26T15:25:25.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 >> v1:172.21.15.129:6800/16899 conn(0x7fb258048800 legacy=0x7fb25804ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 msgr2=0x7fb25800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:25.211 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb27359e700 1 -- 172.21.15.129:0/1346091471 reap_dead start 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fb26c000b20 tx=0x7fb26c002760).stop 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 shutdown_connections 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 --2- 172.21.15.129:0/1346091471 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb25800c000 0x7fb25800e440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 >> 172.21.15.129:0/1346091471 conn(0x7fb2740a56b0 msgr2=0x7fb2740a1420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 shutdown_connections 2020-01-26T15:25:25.212 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:25.206+0000 7fb278b8e700 1 -- 172.21.15.129:0/1346091471 wait complete. 2020-01-26T15:25:25.213 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:25.220 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:28.221 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 Processor -- start 2020-01-26T15:25:28.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- start start 2020-01-26T15:25:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 0x7f5f8814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8805ea20 con 0x7f5f8805e5f0 2020-01-26T15:25:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f88098000 con 0x7f5f8805edd0 2020-01-26T15:25:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8805e050 con 0x7f5f880a6870 2020-01-26T15:25:28.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8cd81700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 0x7f5f8814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8cd81700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 0x7f5f8814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8659c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f5f8805e5f0 0x7f5f88149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48716/0 (socket says 172.21.15.129:48716) 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f86d9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f5f8805edd0 0x7f5f8807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46328/0 (socket says 172.21.15.129:46328) 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8659c700 1 -- 172.21.15.129:0/2987049531 learned_addr learned my addr 172.21.15.129:0/2987049531 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906158384 0 0) 0x7f5f8805ea20 con 0x7f5f8805e5f0 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f74003230 con 0x7f5f8805e5f0 2020-01-26T15:25:28.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735920428 0 0) 0x7f5f88098000 con 0x7f5f8805edd0 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f8805ea20 con 0x7f5f8805edd0 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1354367335 0 0) 0x7f5f74003230 con 0x7f5f8805e5f0 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 msgr2=0x7f5f8814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 --2- 172.21.15.129:0/2987049531 >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 0x7f5f8814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 >> v1:172.21.15.129:6791/0 conn(0x7f5f8805edd0 legacy=0x7f5f8807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:28.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880a6ca0 con 0x7f5f8805e5f0 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5f70001640 con 0x7f5f8805e5f0 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f70001910 con 0x7f5f8805e5f0 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f85d9b700 1 -- 172.21.15.129:0/2987049531 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5f700045b0 con 0x7f5f8805e5f0 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- 172.21.15.129:0/2987049531 >> v1:172.21.15.129:6790/0 conn(0x7f5f8805e5f0 legacy=0x7f5f88149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- 172.21.15.129:0/2987049531 shutdown_connections 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 --2- 172.21.15.129:0/2987049531 >> v2:172.21.15.129:6790/0 conn(0x7f5f880a6870 0x7f5f8814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:28.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- 172.21.15.129:0/2987049531 >> 172.21.15.129:0/2987049531 conn(0x7f5f88098e70 msgr2=0x7f5f880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- 172.21.15.129:0/2987049531 shutdown_connections 2020-01-26T15:25:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.346+0000 7f5f8759e700 1 -- 172.21.15.129:0/2987049531 wait complete. 2020-01-26T15:25:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 Processor -- start 2020-01-26T15:25:28.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- start start 2020-01-26T15:25:28.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 0x7f5f8809ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:28.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 0x7f5f880a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:28.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8809f2b0 con 0x7f5f8812cb10 2020-01-26T15:25:28.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8809edd0 con 0x7f5f8806fab0 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8812cf40 con 0x7f5f880a0780 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8cd81700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 0x7f5f880a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f86d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 0x7f5f8809ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8659c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f5f8812cb10 0x7f5f8812d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48718/0 (socket says 172.21.15.129:48718) 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8659c700 1 -- 172.21.15.129:0/2135759756 learned_addr learned my addr 172.21.15.129:0/2135759756 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8cd81700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 0x7f5f880a0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:28.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f86d9d700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 0x7f5f8809ff30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112084940 0 0) 0x7f5f8809f2b0 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f6c003230 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 572118737 0 0) 0x7f5f6c003230 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5f8809f2b0 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5f70001910 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1316434037 0 0) 0x7f5f8809f2b0 con 0x7f5f8812cb10 2020-01-26T15:25:28.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 msgr2=0x7f5f880a0bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 0x7f5f880a0bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 msgr2=0x7f5f8809ff30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 0x7f5f8809ff30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8809fac0 con 0x7f5f8812cb10 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8812da20 con 0x7f5f8812cb10 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f88137520 con 0x7f5f8812cb10 2020-01-26T15:25:28.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f70001c30 con 0x7f5f8812cb10 2020-01-26T15:25:28.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.350+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5f70004ce0 con 0x7f5f8812cb10 2020-01-26T15:25:28.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.354+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f5f700107a0 con 0x7f5f8812cb10 2020-01-26T15:25:28.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.354+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f88056600 con 0x7f5f8812cb10 2020-01-26T15:25:28.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.354+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f5f7004b9b0 con 0x7f5f8812cb10 2020-01-26T15:25:28.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.362+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f5f70030d90 con 0x7f5f8812cb10 2020-01-26T15:25:28.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5f8805cc60 con 0x7f5f8812cb10 2020-01-26T15:25:28.519 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f7f7fe700 1 -- 172.21.15.129:0/2135759756 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f5f70030ff0 con 0x7f5f8812cb10 2020-01-26T15:25:28.520 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:28.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 >> v1:172.21.15.129:6800/16899 conn(0x7f5f6c040380 legacy=0x7f5f6c042890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:28.520 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 >> v1:172.21.15.129:6790/0 conn(0x7f5f8812cb10 legacy=0x7f5f8812d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 shutdown_connections 2020-01-26T15:25:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6791/0 conn(0x7f5f880a0780 0x7f5f880a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:28.521 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 --2- 172.21.15.129:0/2135759756 >> v2:172.21.15.129:6790/0 conn(0x7f5f8806fab0 0x7f5f8809ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 >> 172.21.15.129:0/2135759756 conn(0x7f5f880a6870 msgr2=0x7f5f8807df00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 shutdown_connections 2020-01-26T15:25:28.522 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:28.518+0000 7f5f8759e700 1 -- 172.21.15.129:0/2135759756 wait complete. 2020-01-26T15:25:28.532 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:31.533 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:31.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 Processor -- start 2020-01-26T15:25:31.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 -- start start 2020-01-26T15:25:31.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f941c0a6870 0x7f941c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:31.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c05ea20 con 0x7f941c05e5f0 2020-01-26T15:25:31.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c098000 con 0x7f941c05edd0 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942191f700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f941c05e050 con 0x7f941c0a6870 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942091d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f941c05e5f0 0x7f941c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40428/0 (socket says 172.21.15.129:40428) 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f942091d700 1 -- 172.21.15.129:0/2576538039 learned_addr learned my addr 172.21.15.129:0/2576538039 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f9422b81700 -1 --2- 172.21.15.129:0/2576538039 >> v2:172.21.15.129:6791/0 conn(0x7f941c0a6870 0x7f941c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f9422b81700 1 --2- 172.21.15.129:0/2576538039 >> v2:172.21.15.129:6791/0 conn(0x7f941c0a6870 0x7f941c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:31.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.658+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538525576 0 0) 0x7f941c05ea20 con 0x7f941c05e5f0 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9408003230 con 0x7f941c05e5f0 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337949385 0 0) 0x7f941c098000 con 0x7f941c05edd0 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941c05ea20 con 0x7f941c05edd0 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 329431183 0 0) 0x7f9408003230 con 0x7f941c05e5f0 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 >> v2:172.21.15.129:6791/0 conn(0x7f941c0a6870 msgr2=0x7f941c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 --2- 172.21.15.129:0/2576538039 >> v2:172.21.15.129:6791/0 conn(0x7f941c0a6870 0x7f941c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:31.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 >> v1:172.21.15.129:6791/0 conn(0x7f941c05edd0 legacy=0x7f941c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0a6ca0 con 0x7f941c05e5f0 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f940c001710 con 0x7f941c05e5f0 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 >> v1:172.21.15.129:6789/0 conn(0x7f941c05e5f0 legacy=0x7f941c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9408003230 con 0x7f94080045a0 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f941c098000 con 0x7f940800a7f0 2020-01-26T15:25:31.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c05e050 con 0x7f9408003ac0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156323323 0 0) 0x7f9408003230 con 0x7f94080045a0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f940800e440 con 0x7f94080045a0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727661982 0 0) 0x7f941c098000 con 0x7f940800a7f0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9408003230 con 0x7f940800a7f0 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 -- 172.21.15.129:0/2576538039 >> v1:172.21.15.129:6791/0 conn(0x7f940800a7f0 legacy=0x7f940800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 -- 172.21.15.129:0/2576538039 >> v1:172.21.15.129:6790/0 conn(0x7f94080045a0 legacy=0x7f94080049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 -- 172.21.15.129:0/2576538039 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408054530 con 0x7f9408003ac0 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9418000fc0 tx=0x7f941800bfd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9418000fc0 tx=0x7f941800bfd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f9418000fc0 tx=0x7f941800bfd0).ready entity=mon.0 client_cookie=a8b9eb4ae9281ef1 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9418000fc0 tx=0x7f941800bfd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9418010a40 con 0x7f9408003ac0 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9418000fc0 tx=0x7f941800bfd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942111e700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f9418000fc0 tx=0x7f941800bfd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418010c40 con 0x7f9408003ac0 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9413fff700 1 -- 172.21.15.129:0/2576538039 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f941800c700 con 0x7f9408003ac0 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 -- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 msgr2=0x7f9408003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 --2- 172.21.15.129:0/2576538039 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9408003ac0 0x7f9408003f10 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f9418000fc0 tx=0x7f941800bfd0).stop 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f9422b81700 1 -- 172.21.15.129:0/2576538039 reap_dead start 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 -- 172.21.15.129:0/2576538039 shutdown_connections 2020-01-26T15:25:31.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 -- 172.21.15.129:0/2576538039 >> 172.21.15.129:0/2576538039 conn(0x7f941c098e70 msgr2=0x7f941c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:31.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 -- 172.21.15.129:0/2576538039 shutdown_connections 2020-01-26T15:25:31.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.662+0000 7f942191f700 1 -- 172.21.15.129:0/2576538039 wait complete. 2020-01-26T15:25:31.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942191f700 1 Processor -- start 2020-01-26T15:25:31.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942191f700 1 -- start start 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942191f700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c123d80 con 0x7f941c07d560 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942191f700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c1243f0 con 0x7f941c0a1fc0 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942191f700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c09ecb0 con 0x7f941c07d130 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942091d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f941c07d130 0x7f941c1386b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46356/0 (socket says 172.21.15.129:46356) 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942091d700 1 -- 172.21.15.129:0/1229911473 learned_addr learned my addr 172.21.15.129:0/1229911473 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:31.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f942111e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f941c0a1fc0 0x7f941c09f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48738/0 (socket says 172.21.15.129:48738) 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751599071 0 0) 0x7f941c09ecb0 con 0x7f941c07d130 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003230 con 0x7f941c07d130 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930556805 0 0) 0x7f941c123d80 con 0x7f941c07d560 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941c09ecb0 con 0x7f941c07d560 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150217643 0 0) 0x7f941c1243f0 con 0x7f941c0a1fc0 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941c123d80 con 0x7f941c0a1fc0 2020-01-26T15:25:31.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2277463742 0 0) 0x7f93fc003230 con 0x7f941c07d130 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f941c1243f0 con 0x7f941c07d130 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2572823756 0 0) 0x7f941c09ecb0 con 0x7f941c07d560 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f93fc003230 con 0x7f941c07d560 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f940c001630 con 0x7f941c07d130 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9414001980 con 0x7f941c07d560 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6791/0 conn(0x7f941c07d130 legacy=0x7f941c1386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6790/0 conn(0x7f941c0a1fc0 legacy=0x7f941c09f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6789/0 conn(0x7f941c07d560 legacy=0x7f941c13bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f941c123d80 con 0x7f93fc003a90 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f941c09ecb0 con 0x7f93fc003f70 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.666+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc010830 con 0x7f93fc005170 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:31.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453267751 0 0) 0x7f941c123d80 con 0x7f93fc003a90 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc00e810 con 0x7f93fc003a90 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004958584 0 0) 0x7f941c09ecb0 con 0x7f93fc003f70 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941c123d80 con 0x7f93fc003f70 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6791/0 conn(0x7f93fc003f70 legacy=0x7f93fc00d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6790/0 conn(0x7f93fc003a90 legacy=0x7f93fc0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f941c0968f0 con 0x7f93fc005170 2020-01-26T15:25:31.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c072c00 con 0x7f93fc005170 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c09e180 con 0x7f93fc005170 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9418006840 con 0x7f93fc005170 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418006a80 con 0x7f93fc005170 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c056600 con 0x7f93fc005170 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f941800e160 con 0x7f93fc005170 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.670+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f941804d710 con 0x7f93fc005170 2020-01-26T15:25:31.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.678+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.685 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.678+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f9418033ae0 con 0x7f93fc005170 2020-01-26T15:25:31.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f941c0732b0 con 0x7f93fc005170 2020-01-26T15:25:31.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f942111e700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:31.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f9411ffb700 1 -- 172.21.15.129:0/1229911473 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f9418033d40 con 0x7f93fc005170 2020-01-26T15:25:31.833 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:31.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 >> v1:172.21.15.129:6800/16899 conn(0x7f93fc048700 legacy=0x7f93fc04ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 msgr2=0x7f93fc003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:31.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f942191f700 1 --2- 172.21.15.129:0/1229911473 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f93fc005170 0x7f93fc003540 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f941800b6f0 tx=0x7f9418010170).stop 2020-01-26T15:25:31.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.830+0000 7f9422b81700 1 -- 172.21.15.129:0/1229911473 reap_dead start 2020-01-26T15:25:31.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.834+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 shutdown_connections 2020-01-26T15:25:31.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.834+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 >> 172.21.15.129:0/1229911473 conn(0x7f941c098e10 msgr2=0x7f941c07f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:31.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.834+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 shutdown_connections 2020-01-26T15:25:31.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:31.834+0000 7f942191f700 1 -- 172.21.15.129:0/1229911473 wait complete. 2020-01-26T15:25:31.845 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:34.846 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:34.967 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a06bfb700 1 Processor -- start 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a06bfb700 1 -- start start 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a06bfb700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a000a5b80 con 0x7f4a00146c30 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a06bfb700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a00080440 con 0x7f4a000a5750 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a06bfb700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a000a4e00 con 0x7f4a0014a880 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a04997700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4a00146c30 0x7f4a00149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40456/0 (socket says 172.21.15.129:40456) 2020-01-26T15:25:34.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a04997700 1 -- 172.21.15.129:0/3100344025 learned_addr learned my addr 172.21.15.129:0/3100344025 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05198700 1 --1- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6790/0 conn(0x7f4a000a5750 0x7f4a000a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48752/0 (socket says 172.21.15.129:48752) 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 --1- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6791/0 conn(0x7f4a0014a880 0x7f4a0014ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46370/0 (socket says 172.21.15.129:46370) 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344383397 0 0) 0x7f4a000a5b80 con 0x7f4a00146c30 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e8003230 con 0x7f4a00146c30 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604334472 0 0) 0x7f4a000a4e00 con 0x7f4a0014a880 2020-01-26T15:25:34.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000a5b80 con 0x7f4a0014a880 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508389760 0 0) 0x7f4a00080440 con 0x7f4a000a5750 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000a4e00 con 0x7f4a000a5750 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1796688297 0 0) 0x7f49e8003230 con 0x7f4a00146c30 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6791/0 conn(0x7f4a0014a880 legacy=0x7f4a0014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6790/0 conn(0x7f4a000a5750 legacy=0x7f4a000a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a000a3210 con 0x7f4a00146c30 2020-01-26T15:25:34.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f49f4001a90 con 0x7f4a00146c30 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6789/0 conn(0x7f4a00146c30 legacy=0x7f4a00149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f49e8003230 con 0x7f49e8004da0 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a000a4e00 con 0x7f49e8003d20 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8004150 con 0x7f49e800c000 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:34.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909863272 0 0) 0x7f4a000a4e00 con 0x7f49e8003d20 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000a5b80 con 0x7f49e8003d20 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427300875 0 0) 0x7f49e8003230 con 0x7f49e8004da0 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000a4e00 con 0x7f49e8004da0 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 -- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6791/0 conn(0x7f49e8003d20 legacy=0x7f49e80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1414678463 0 0) 0x7f4a000a4e00 con 0x7f49e8004da0 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 -- 172.21.15.129:0/3100344025 >> v1:172.21.15.129:6790/0 conn(0x7f49e8004da0 legacy=0x7f49e800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 -- 172.21.15.129:0/3100344025 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8004310 con 0x7f49e800c000 2020-01-26T15:25:34.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.962+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).ready entity=mon.0 client_cookie=c3ca6ba2ad9a9dcb server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f49f4004930 con 0x7f49e800c000 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f0001980 con 0x7f49e800c000 2020-01-26T15:25:34.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a05999700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.974 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 msgr2=0x7f49e800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f49fffff700 1 -- 172.21.15.129:0/3100344025 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f49f00044f0 con 0x7f49e800c000 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f49f0001de0 tx=0x7f49f4001fa0).stop 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- 172.21.15.129:0/3100344025 shutdown_connections 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 --2- 172.21.15.129:0/3100344025 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e800c000 0x7f49e800e440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- 172.21.15.129:0/3100344025 >> 172.21.15.129:0/3100344025 conn(0x7f4a0005e050 msgr2=0x7f4a00098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- 172.21.15.129:0/3100344025 shutdown_connections 2020-01-26T15:25:34.975 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- 172.21.15.129:0/3100344025 wait complete. 2020-01-26T15:25:34.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 Processor -- start 2020-01-26T15:25:34.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- start start 2020-01-26T15:25:34.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4a000a1d00 0x7f4a0007cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:34.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a000a2ae0 con 0x7f4a0007d080 2020-01-26T15:25:34.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0011e6c0 con 0x7f4a0011e290 2020-01-26T15:25:34.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.966+0000 7f4a06bfb700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4a000a1a60 con 0x7f4a000a1d00 2020-01-26T15:25:34.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a04997700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f4a0007d080 0x7f4a0011da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40466/0 (socket says 172.21.15.129:40466) 2020-01-26T15:25:34.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a04997700 1 -- 172.21.15.129:0/2892868019 learned_addr learned my addr 172.21.15.129:0/2892868019 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 -1 --2- 172.21.15.129:0/2892868019 >> v2:172.21.15.129:6791/0 conn(0x7f4a000a1d00 0x7f4a0007cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> v2:172.21.15.129:6791/0 conn(0x7f4a000a1d00 0x7f4a0007cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311963449 0 0) 0x7f4a000a2ae0 con 0x7f4a0007d080 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e0003230 con 0x7f4a0007d080 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885340532 0 0) 0x7f4a0011e6c0 con 0x7f4a0011e290 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a000a2ae0 con 0x7f4a0011e290 2020-01-26T15:25:34.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3941934298 0 0) 0x7f49e0003230 con 0x7f4a0007d080 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a0011e6c0 con 0x7f4a0007d080 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f49f4004870 con 0x7f4a0007d080 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 >> v2:172.21.15.129:6791/0 conn(0x7f4a000a1d00 msgr2=0x7f4a0007cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 --2- 172.21.15.129:0/2892868019 >> v2:172.21.15.129:6791/0 conn(0x7f4a000a1d00 0x7f4a0007cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 >> v1:172.21.15.129:6791/0 conn(0x7f4a0011e290 legacy=0x7f4a0013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 >> v1:172.21.15.129:6789/0 conn(0x7f4a0007d080 legacy=0x7f4a0011da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f49e0003230 con 0x7f49e00040b0 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f49e000f450 con 0x7f49e000a7f0 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000a1a60 con 0x7f49e0003c30 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390702027 0 0) 0x7f49e0003230 con 0x7f49e00040b0 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e000e440 con 0x7f49e00040b0 2020-01-26T15:25:34.987 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 -- 172.21.15.129:0/2892868019 >> v1:172.21.15.129:6791/0 conn(0x7f49e000a7f0 legacy=0x7f49e000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404060788 0 0) 0x7f49e000f450 con 0x7f49e000a7f0 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 -- 172.21.15.129:0/2892868019 >> v1:172.21.15.129:6790/0 conn(0x7f49e00040b0 legacy=0x7f49e0004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0005b410 con 0x7f49e0003c30 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a00095310 con 0x7f49e0003c30 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0011e430 con 0x7f49e0003c30 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.988 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f49f0004ae0 con 0x7f49e0003c30 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f000a0a0 con 0x7f49e0003c30 2020-01-26T15:25:34.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f49f0012560 con 0x7f49e0003c30 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.970+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d8003360 con 0x7f49e0003c30 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.974+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.974+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f49f0012830 con 0x7f49e0003c30 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.974+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f49f004d0e0 con 0x7f49e0003c30 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.978+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:34.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:34.978+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f49f0033250 con 0x7f49e0003c30 2020-01-26T15:25:35.134 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.130+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f49d8003790 con 0x7f49e0003c30 2020-01-26T15:25:35.134 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a05198700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:35.134 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f49fdffb700 1 -- 172.21.15.129:0/2892868019 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f49f00334b0 con 0x7f49e0003c30 2020-01-26T15:25:35.135 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:35.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 >> v1:172.21.15.129:6800/16899 conn(0x7f49e00483b0 legacy=0x7f49e004a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:35.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 msgr2=0x7f49e00045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:35.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 --2- 172.21.15.129:0/2892868019 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49e0003c30 0x7f49e00045a0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7f49f0000b80 tx=0x7f49f0010ab0).stop 2020-01-26T15:25:35.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a05999700 1 -- 172.21.15.129:0/2892868019 reap_dead start 2020-01-26T15:25:35.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a05999700 1 -- 172.21.15.129:0/2892868019 reap_dead start 2020-01-26T15:25:35.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 shutdown_connections 2020-01-26T15:25:35.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 >> 172.21.15.129:0/2892868019 conn(0x7f4a00097240 msgr2=0x7f4a0007f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:35.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 shutdown_connections 2020-01-26T15:25:35.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:35.134+0000 7f4a06bfb700 1 -- 172.21.15.129:0/2892868019 wait complete. 2020-01-26T15:25:35.147 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:38.149 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:38.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.262+0000 7f2b3d960700 1 Processor -- start 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.262+0000 7f2b3d960700 1 -- start start 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2b38146c30 0x7f2b38149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b380a5b80 con 0x7f2b380a5750 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b38080440 con 0x7f2b381495c0 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2b380a43f0 con 0x7f2b38146c30 2020-01-26T15:25:38.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b36ffd700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2b38146c30 0x7f2b38149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b36ffd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2b38146c30 0x7f2b38149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b37fff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f2b381495c0 0x7f2b3814ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46398/0 (socket says 172.21.15.129:46398) 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b37fff700 1 -- 172.21.15.129:0/1435951804 learned_addr learned my addr 172.21.15.129:0/1435951804 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074177287 0 0) 0x7f2b380a5b80 con 0x7f2b380a5750 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b20003230 con 0x7f2b380a5750 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213784386 0 0) 0x7f2b38080440 con 0x7f2b381495c0 2020-01-26T15:25:38.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b380a5b80 con 0x7f2b381495c0 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1270268304 0 0) 0x7f2b20003230 con 0x7f2b380a5750 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 >> v2:172.21.15.129:6790/0 conn(0x7f2b38146c30 msgr2=0x7f2b38149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 --2- 172.21.15.129:0/1435951804 >> v2:172.21.15.129:6790/0 conn(0x7f2b38146c30 0x7f2b38149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 >> v1:172.21.15.129:6791/0 conn(0x7f2b381495c0 legacy=0x7f2b3814ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380a4e00 con 0x7f2b380a5750 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2b28001710 con 0x7f2b380a5750 2020-01-26T15:25:38.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 >> v1:172.21.15.129:6789/0 conn(0x7f2b380a5750 legacy=0x7f2b380a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b20003230 con 0x7f2b200045a0 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b38080440 con 0x7f2b2000a7f0 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b380a43f0 con 0x7f2b20003a90 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 -- 172.21.15.129:0/1435951804 >> v1:172.21.15.129:6791/0 conn(0x7f2b2000a7f0 legacy=0x7f2b2000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 -- 172.21.15.129:0/1435951804 >> v1:172.21.15.129:6790/0 conn(0x7f2b200045a0 legacy=0x7f2b20004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 -- 172.21.15.129:0/1435951804 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20054560 con 0x7f2b20003a90 2020-01-26T15:25:38.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b28001520 tx=0x7f2b2800c190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b28001520 tx=0x7f2b2800c190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f2b28001520 tx=0x7f2b2800c190).ready entity=mon.0 client_cookie=324b7e082b513d33 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f2b28001520 tx=0x7f2b2800c190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b2800eb80 con 0x7f2b20003a90 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f2b28001520 tx=0x7f2b2800c190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b377fe700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7f2b28001520 tx=0x7f2b2800c190).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800ed80 con 0x7f2b20003a90 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b367fc700 1 -- 172.21.15.129:0/1435951804 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b2800c960 con 0x7f2b20003a90 2020-01-26T15:25:38.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 msgr2=0x7f2b20003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 --2- 172.21.15.129:0/1435951804 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b20003a90 0x7f2b20003ee0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f2b28001520 tx=0x7f2b2800c190).stop 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b37fff700 1 -- 172.21.15.129:0/1435951804 reap_dead start 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- 172.21.15.129:0/1435951804 shutdown_connections 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- 172.21.15.129:0/1435951804 >> 172.21.15.129:0/1435951804 conn(0x7f2b3805e050 msgr2=0x7f2b38098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- 172.21.15.129:0/1435951804 shutdown_connections 2020-01-26T15:25:38.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.266+0000 7f2b3d960700 1 -- 172.21.15.129:0/1435951804 wait complete. 2020-01-26T15:25:38.280 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b3d960700 1 Processor -- start 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b3d960700 1 -- start start 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b3d960700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b38071e70 con 0x7f2b3808ffc0 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b3d960700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b380735f0 con 0x7f2b380731c0 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b3d960700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b380903f0 con 0x7f2b38070c70 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b36ffd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f2b3808ffc0 0x7f2b38070470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40492/0 (socket says 172.21.15.129:40492) 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b36ffd700 1 -- 172.21.15.129:0/3688327451 learned_addr learned my addr 172.21.15.129:0/3688327451 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:38.281 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b37fff700 1 --1- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6791/0 conn(0x7f2b38070c70 0x7f2b381387f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46410/0 (socket says 172.21.15.129:46410) 2020-01-26T15:25:38.282 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345604424 0 0) 0x7f2b38071e70 con 0x7f2b3808ffc0 2020-01-26T15:25:38.282 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b18003230 con 0x7f2b3808ffc0 2020-01-26T15:25:38.282 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663017225 0 0) 0x7f2b380735f0 con 0x7f2b380731c0 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b38071e70 con 0x7f2b380731c0 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816318856 0 0) 0x7f2b380903f0 con 0x7f2b38070c70 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b380735f0 con 0x7f2b38070c70 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1623999865 0 0) 0x7f2b18003230 con 0x7f2b3808ffc0 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b380903f0 con 0x7f2b3808ffc0 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2988274458 0 0) 0x7f2b380735f0 con 0x7f2b38070c70 2020-01-26T15:25:38.283 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2b18003230 con 0x7f2b38070c70 2020-01-26T15:25:38.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2b2c002670 con 0x7f2b3808ffc0 2020-01-26T15:25:38.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6791/0 conn(0x7f2b38070c70 legacy=0x7f2b381387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6790/0 conn(0x7f2b380731c0 legacy=0x7f2b3806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6789/0 conn(0x7f2b3808ffc0 legacy=0x7f2b38070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.284 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b38071e70 con 0x7f2b18003ec0 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2b380735f0 con 0x7f2b1800aff0 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180053d0 con 0x7f2b18003540 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.270+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074277081 0 0) 0x7f2b38071e70 con 0x7f2b18003ec0 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b1800ec40 con 0x7f2b18003ec0 2020-01-26T15:25:38.285 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353907313 0 0) 0x7f2b380735f0 con 0x7f2b1800aff0 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6791/0 conn(0x7f2b1800aff0 legacy=0x7f2b1800d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6790/0 conn(0x7f2b18003ec0 legacy=0x7f2b180097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3813d030 con 0x7f2b18003540 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b38070c70 con 0x7f2b18003540 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b380731c0 con 0x7f2b18003540 2020-01-26T15:25:38.286 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b280101b0 con 0x7f2b18003540 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b280103b0 con 0x7f2b18003540 2020-01-26T15:25:38.287 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2b280107d0 con 0x7f2b18003540 2020-01-26T15:25:38.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b10003360 con 0x7f2b18003540 2020-01-26T15:25:38.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2b280064e0 con 0x7f2b18003540 2020-01-26T15:25:38.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.288 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.274+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f2b2804deb0 con 0x7f2b18003540 2020-01-26T15:25:38.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.282+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.289 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.282+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2b280342c0 con 0x7f2b18003540 2020-01-26T15:25:38.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2b10003790 con 0x7f2b18003540 2020-01-26T15:25:38.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b377fe700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:38.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b1ffff700 1 -- 172.21.15.129:0/3688327451 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2b28034e70 con 0x7f2b18003540 2020-01-26T15:25:38.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 >> v1:172.21.15.129:6800/16899 conn(0x7f2b18048980 legacy=0x7f2b1804ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 msgr2=0x7f2b18003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:38.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 --2- 172.21.15.129:0/3688327451 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2b18003540 0x7f2b18003970 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f2b2800b900 tx=0x7f2b2800e3f0).stop 2020-01-26T15:25:38.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b37fff700 1 -- 172.21.15.129:0/3688327451 reap_dead start 2020-01-26T15:25:38.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 shutdown_connections 2020-01-26T15:25:38.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 >> 172.21.15.129:0/3688327451 conn(0x7f2b380971a0 msgr2=0x7f2b3807f470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:38.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 shutdown_connections 2020-01-26T15:25:38.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:38.438+0000 7f2b3d960700 1 -- 172.21.15.129:0/3688327451 wait complete. 2020-01-26T15:25:38.451 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:38.458 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:41.459 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:41.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 Processor -- start 2020-01-26T15:25:41.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- start start 2020-01-26T15:25:41.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 0x7f899c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:41.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0a6dc0 con 0x7f899c05edd0 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c05ea20 con 0x7f899c149040 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f899c098000 con 0x7f899c05e5f0 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a1079700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 0x7f899c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a1079700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 0x7f899c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a187a700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f899c05edd0 0x7f899c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48804/0 (socket says 172.21.15.129:48804) 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a32dd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f899c149040 0x7f899c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46422/0 (socket says 172.21.15.129:46422) 2020-01-26T15:25:41.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a187a700 1 -- 172.21.15.129:0/3931080113 learned_addr learned my addr 172.21.15.129:0/3931080113 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:41.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306861882 0 0) 0x7f899c05ea20 con 0x7f899c149040 2020-01-26T15:25:41.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003230 con 0x7f899c149040 2020-01-26T15:25:41.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279544656 0 0) 0x7f899c0a6dc0 con 0x7f899c05edd0 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899c05ea20 con 0x7f899c05edd0 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2037917061 0 0) 0x7f8984003230 con 0x7f899c149040 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 msgr2=0x7f899c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 --2- 172.21.15.129:0/3931080113 >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 0x7f899c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 >> v1:172.21.15.129:6790/0 conn(0x7f899c05edd0 legacy=0x7f899c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c05e050 con 0x7f899c149040 2020-01-26T15:25:41.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8990001640 con 0x7f899c149040 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8990001910 con 0x7f899c149040 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a0878700 1 -- 172.21.15.129:0/3931080113 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f89900044f0 con 0x7f899c149040 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- 172.21.15.129:0/3931080113 >> v1:172.21.15.129:6791/0 conn(0x7f899c149040 legacy=0x7f899c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- 172.21.15.129:0/3931080113 shutdown_connections 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 --2- 172.21.15.129:0/3931080113 >> v2:172.21.15.129:6791/0 conn(0x7f899c05e5f0 0x7f899c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- 172.21.15.129:0/3931080113 >> 172.21.15.129:0/3931080113 conn(0x7f899c098e70 msgr2=0x7f899c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- 172.21.15.129:0/3931080113 shutdown_connections 2020-01-26T15:25:41.584 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.574+0000 7f89a207b700 1 -- 172.21.15.129:0/3931080113 wait complete. 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 Processor -- start 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- start start 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f899c07c9e0 0x7f899c07ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f899c07d360 0x7f899c138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c07d790 con 0x7f899c099a00 2020-01-26T15:25:41.590 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0a1040 con 0x7f899c07c9e0 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0a1b20 con 0x7f899c07d360 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f899c07d360 0x7f899c138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a187a700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f899c099a00 0x7f899c123880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40508/0 (socket says 172.21.15.129:40508) 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a187a700 1 -- 172.21.15.129:0/2198535344 learned_addr learned my addr 172.21.15.129:0/2198535344 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6791/0 conn(0x7f899c07d360 0x7f899c138860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a1079700 -1 --2- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6790/0 conn(0x7f899c07c9e0 0x7f899c07ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a1079700 1 --2- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6790/0 conn(0x7f899c07c9e0 0x7f899c07ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:41.591 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532511691 0 0) 0x7f899c07d790 con 0x7f899c099a00 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c003230 con 0x7f899c099a00 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2796873203 0 0) 0x7f897c003230 con 0x7f899c099a00 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f899c07d790 con 0x7f899c099a00 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f898c001850 con 0x7f899c099a00 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6791/0 conn(0x7f899c07d360 msgr2=0x7f899c138860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:41.592 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 --2- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6791/0 conn(0x7f899c07d360 0x7f899c138860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:41.593 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6790/0 conn(0x7f899c07c9e0 msgr2=0x7f899c07ce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 --2- 172.21.15.129:0/2198535344 >> v2:172.21.15.129:6790/0 conn(0x7f899c07c9e0 0x7f899c07ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 >> v1:172.21.15.129:6789/0 conn(0x7f899c099a00 legacy=0x7f899c123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f897c003230 con 0x7f897c003a20 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f897c00f250 con 0x7f897c003ed0 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0a1040 con 0x7f897c00b800 2020-01-26T15:25:41.594 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226054170 0 0) 0x7f897c003230 con 0x7f897c003a20 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c00e440 con 0x7f897c003a20 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184281212 0 0) 0x7f897c00f250 con 0x7f897c003ed0 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c003230 con 0x7f897c003ed0 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2012573103 0 0) 0x7f897c00e440 con 0x7f897c003a20 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f897c00f250 con 0x7f897c003a20 2020-01-26T15:25:41.595 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f898c004ab0 con 0x7f897c003a20 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 -- 172.21.15.129:0/2198535344 >> v1:172.21.15.129:6791/0 conn(0x7f897c003ed0 legacy=0x7f897c004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 -- 172.21.15.129:0/2198535344 >> v1:172.21.15.129:6790/0 conn(0x7f897c003a20 legacy=0x7f897c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1973125655 0 0) 0x7f897c00f250 con 0x7f897c003a20 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c09a990 con 0x7f897c00b800 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c11ef50 con 0x7f897c00b800 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.596 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 -- 172.21.15.129:0/2198535344 reap_dead start 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0a37c0 con 0x7f897c00b800 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.578+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.597 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f899000f170 con 0x7f897c00b800 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899000f370 con 0x7f897c00b800 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8990008180 con 0x7f897c00b800 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978003360 con 0x7f897c00b800 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.598 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f8990008380 con 0x7f897c00b800 2020-01-26T15:25:41.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.582+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f899004c770 con 0x7f897c00b800 2020-01-26T15:25:41.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.586+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.599 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.586+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8990008d20 con 0x7f897c00b800 2020-01-26T15:25:41.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.734+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8978003790 con 0x7f897c00b800 2020-01-26T15:25:41.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a32dd700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:41.738 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f899a7fc700 1 -- 172.21.15.129:0/2198535344 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f89900336b0 con 0x7f897c00b800 2020-01-26T15:25:41.738 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:41.739 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 >> v1:172.21.15.129:6800/16899 conn(0x7f897c040bc0 legacy=0x7f897c0430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 msgr2=0x7f897c00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f8990001100 tx=0x7f898c001d20).stop 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 shutdown_connections 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 --2- 172.21.15.129:0/2198535344 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f897c00b800 0x7f897c00dc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 >> 172.21.15.129:0/2198535344 conn(0x7f899c122460 msgr2=0x7f899c07f260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:41.740 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 shutdown_connections 2020-01-26T15:25:41.741 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:41.738+0000 7f89a207b700 1 -- 172.21.15.129:0/2198535344 wait complete. 2020-01-26T15:25:41.751 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:44.751 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:44.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 Processor -- start 2020-01-26T15:25:44.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 -- start start 2020-01-26T15:25:44.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 0x7f2e7c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:44.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c0a5b80 con 0x7f2e7c0a5750 2020-01-26T15:25:44.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c080440 con 0x7f2e7c1495c0 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0a43f0 con 0x7f2e7c146c30 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7b7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 0x7f2e7c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7bfff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f2e7c0a5750 0x7f2e7c0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40522/0 (socket says 172.21.15.129:40522) 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7bfff700 1 -- 172.21.15.129:0/2428423790 learned_addr learned my addr 172.21.15.129:0/2428423790 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e80d55700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f2e7c1495c0 0x7f2e7c14ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48824/0 (socket says 172.21.15.129:48824) 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2428423790 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 0x7f2e7c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:44.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038810145 0 0) 0x7f2e7c0a5b80 con 0x7f2e7c0a5750 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e68003230 con 0x7f2e7c0a5750 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605871003 0 0) 0x7f2e7c080440 con 0x7f2e7c1495c0 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c0a5b80 con 0x7f2e7c1495c0 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 279832610 0 0) 0x7f2e7c0a5b80 con 0x7f2e7c1495c0 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 msgr2=0x7f2e7c149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 --2- 172.21.15.129:0/2428423790 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 0x7f2e7c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:44.874 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 >> v1:172.21.15.129:6789/0 conn(0x7f2e7c0a5750 legacy=0x7f2e7c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0a4e00 con 0x7f2e7c1495c0 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2e6c0016f0 con 0x7f2e7c1495c0 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2e6c001940 con 0x7f2e7c1495c0 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e7affd700 1 -- 172.21.15.129:0/2428423790 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2e6c0044f0 con 0x7f2e7c1495c0 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.866+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2428423790 >> v1:172.21.15.129:6790/0 conn(0x7f2e7c1495c0 legacy=0x7f2e7c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2428423790 shutdown_connections 2020-01-26T15:25:44.875 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 --2- 172.21.15.129:0/2428423790 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c146c30 0x7f2e7c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:44.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2428423790 >> 172.21.15.129:0/2428423790 conn(0x7f2e7c05e050 msgr2=0x7f2e7c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:44.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2428423790 shutdown_connections 2020-01-26T15:25:44.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2428423790 wait complete. 2020-01-26T15:25:44.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 Processor -- start 2020-01-26T15:25:44.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- start start 2020-01-26T15:25:44.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f2e7c1217b0 0x7f2e7c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2e7c1365e0 0x7f2e7c138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c120fc0 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c11d810 con 0x7f2e7c1365e0 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e81fb7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c122a50 con 0x7f2e7c1217b0 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e80d55700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2e7c1365e0 0x7f2e7c138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:44.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e7b7fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f2e7c0a61b0 0x7f2e7c0a65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40530/0 (socket says 172.21.15.129:40530) 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e80d55700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2e7c1365e0 0x7f2e7c138a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e7b7fe700 1 -- 172.21.15.129:0/2007798169 learned_addr learned my addr 172.21.15.129:0/2007798169 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e7bfff700 -1 --2- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c1217b0 0x7f2e7c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e7bfff700 1 --2- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c1217b0 0x7f2e7c122320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904182404 0 0) 0x7f2e7c120fc0 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.870+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e60003230 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1245295711 0 0) 0x7f2e60003230 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e7c120fc0 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2e64002740 con 0x7f2e7c0a61b0 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c1217b0 msgr2=0x7f2e7c122320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 --2- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6791/0 conn(0x7f2e7c1217b0 0x7f2e7c122320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6790/0 conn(0x7f2e7c1365e0 msgr2=0x7f2e7c138a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 --2- 172.21.15.129:0/2007798169 >> v2:172.21.15.129:6790/0 conn(0x7f2e7c1365e0 0x7f2e7c138a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:44.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 >> v1:172.21.15.129:6789/0 conn(0x7f2e7c0a61b0 legacy=0x7f2e7c0a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:44.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:44.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2e60003230 con 0x7f2e60003a20 2020-01-26T15:25:44.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f2e60005380 con 0x7f2e6000a7f0 2020-01-26T15:25:44.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c11d810 con 0x7f2e60003eb0 2020-01-26T15:25:44.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399866294 0 0) 0x7f2e60003230 con 0x7f2e60003a20 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e6000e440 con 0x7f2e60003a20 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916252854 0 0) 0x7f2e60005380 con 0x7f2e6000a7f0 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e60003230 con 0x7f2e6000a7f0 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 -- 172.21.15.129:0/2007798169 >> v1:172.21.15.129:6791/0 conn(0x7f2e6000a7f0 legacy=0x7f2e6000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 -- 172.21.15.129:0/2007798169 >> v1:172.21.15.129:6790/0 conn(0x7f2e60003a20 legacy=0x7f2e600045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:44.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c07abd0 con 0x7f2e60003eb0 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c11f980 con 0x7f2e60003eb0 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e80d55700 1 -- 172.21.15.129:0/2007798169 reap_dead start 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c11da80 con 0x7f2e60003eb0 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2e64005910 con 0x7f2e60003eb0 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64005b10 con 0x7f2e60003eb0 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f2e64010160 con 0x7f2e60003eb0 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54003360 con 0x7f2e60003eb0 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f2e640103b0 con 0x7f2e60003eb0 2020-01-26T15:25:44.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.874+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.878+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f2e6404e290 con 0x7f2e60003eb0 2020-01-26T15:25:44.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.882+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:44.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:44.882+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f2e64034440 con 0x7f2e60003eb0 2020-01-26T15:25:45.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e54003790 con 0x7f2e60003eb0 2020-01-26T15:25:45.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e7b7fe700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:45.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e78ff9700 1 -- 172.21.15.129:0/2007798169 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f2e640346a0 con 0x7f2e60003eb0 2020-01-26T15:25:45.039 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 >> v1:172.21.15.129:6800/16899 conn(0x7f2e60040b60 legacy=0x7f2e60043070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 msgr2=0x7f2e60004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f2e6400c920 tx=0x7f2e640116f0).stop 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 shutdown_connections 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 --2- 172.21.15.129:0/2007798169 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f2e60003eb0 0x7f2e60004da0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 >> 172.21.15.129:0/2007798169 conn(0x7f2e7c095540 msgr2=0x7f2e7c123e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:45.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 shutdown_connections 2020-01-26T15:25:45.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:45.038+0000 7f2e81fb7700 1 -- 172.21.15.129:0/2007798169 wait complete. 2020-01-26T15:25:45.053 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:48.054 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:48.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 Processor -- start 2020-01-26T15:25:48.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 -- start start 2020-01-26T15:25:48.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7b04146c30 0x7f7b04149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040a5b80 con 0x7f7b040a5750 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04080440 con 0x7f7b041495c0 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0c38b700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7b040a43f0 con 0x7f7b04146c30 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0a127700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7b04146c30 0x7f7b04149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0a928700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7b040a5750 0x7f7b040a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40542/0 (socket says 172.21.15.129:40542) 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0a928700 1 -- 172.21.15.129:0/1979253928 learned_addr learned my addr 172.21.15.129:0/1979253928 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0b129700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f7b041495c0 0x7f7b0414ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46462/0 (socket says 172.21.15.129:46462) 2020-01-26T15:25:48.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b0a127700 1 --2- 172.21.15.129:0/1979253928 >> v2:172.21.15.129:6791/0 conn(0x7f7b04146c30 0x7f7b04149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.166+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571942647 0 0) 0x7f7b040a5b80 con 0x7f7b040a5750 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af0003230 con 0x7f7b040a5750 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662792945 0 0) 0x7f7b04080440 con 0x7f7b041495c0 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b040a5b80 con 0x7f7b041495c0 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2050328280 0 0) 0x7f7af0003230 con 0x7f7b040a5750 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 >> v2:172.21.15.129:6791/0 conn(0x7f7b04146c30 msgr2=0x7f7b04149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:48.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 --2- 172.21.15.129:0/1979253928 >> v2:172.21.15.129:6791/0 conn(0x7f7b04146c30 0x7f7b04149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 >> v1:172.21.15.129:6791/0 conn(0x7f7b041495c0 legacy=0x7f7b0414ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040a4e00 con 0x7f7b040a5750 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7b00001710 con 0x7f7b040a5750 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 >> v1:172.21.15.129:6789/0 conn(0x7f7b040a5750 legacy=0x7f7b040a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:48.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7af0003230 con 0x7f7af0003ee0 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7b04080440 con 0x7f7af0003a90 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040a43f0 con 0x7f7af000b800 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225680331 0 0) 0x7f7b04080440 con 0x7f7af0003a90 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af000e2d0 con 0x7f7af0003a90 2020-01-26T15:25:48.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 -- 172.21.15.129:0/1979253928 >> v1:172.21.15.129:6791/0 conn(0x7f7af0003a90 legacy=0x7f7af00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739045922 0 0) 0x7f7af0003230 con 0x7f7af0003ee0 2020-01-26T15:25:48.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 -- 172.21.15.129:0/1979253928 >> v1:172.21.15.129:6790/0 conn(0x7f7af0003ee0 legacy=0x7f7af0004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 -- 172.21.15.129:0/1979253928 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0054540 con 0x7f7af000b800 2020-01-26T15:25:48.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7afc001380 tx=0x7f7afc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.179 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7afc001380 tx=0x7f7afc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f7afc001380 tx=0x7f7afc010290).ready entity=mon.0 client_cookie=f2562d0525f65d28 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f7afc001380 tx=0x7f7afc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7afc0058a0 con 0x7f7af000b800 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f7afc001380 tx=0x7f7afc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f7afc001380 tx=0x7f7afc010290).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc005aa0 con 0x7f7af000b800 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b09926700 1 -- 172.21.15.129:0/1979253928 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7afc0110c0 con 0x7f7af000b800 2020-01-26T15:25:48.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 -- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 msgr2=0x7f7af000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 --2- 172.21.15.129:0/1979253928 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7af000b800 0x7f7af000dc40 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f7afc001380 tx=0x7f7afc010290).stop 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0b129700 1 -- 172.21.15.129:0/1979253928 reap_dead start 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 -- 172.21.15.129:0/1979253928 shutdown_connections 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 -- 172.21.15.129:0/1979253928 >> 172.21.15.129:0/1979253928 conn(0x7f7b0405e050 msgr2=0x7f7b04098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 -- 172.21.15.129:0/1979253928 shutdown_connections 2020-01-26T15:25:48.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.170+0000 7f7b0c38b700 1 -- 172.21.15.129:0/1979253928 wait complete. 2020-01-26T15:25:48.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 Processor -- start 2020-01-26T15:25:48.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 -- start start 2020-01-26T15:25:48.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7b04091390 0x7f7b04138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:48.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b040917c0 con 0x7f7b0412ca10 2020-01-26T15:25:48.194 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b041217b0 con 0x7f7b04090f60 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0c38b700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7b04120880 con 0x7f7b04091390 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0a928700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7b0412ca10 0x7f7b0412d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40556/0 (socket says 172.21.15.129:40556) 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0a928700 1 -- 172.21.15.129:0/845572951 learned_addr learned my addr 172.21.15.129:0/845572951 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0b129700 -1 --2- 172.21.15.129:0/845572951 >> v2:172.21.15.129:6791/0 conn(0x7f7b04091390 0x7f7b04138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7b0b129700 1 --2- 172.21.15.129:0/845572951 >> v2:172.21.15.129:6791/0 conn(0x7f7b04091390 0x7f7b04138b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:48.195 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453952738 0 0) 0x7f7b040917c0 con 0x7f7b0412ca10 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aec003230 con 0x7f7b0412ca10 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.174+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422753402 0 0) 0x7f7b041217b0 con 0x7f7b04090f60 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b040917c0 con 0x7f7b04090f60 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3204640632 0 0) 0x7f7aec003230 con 0x7f7b0412ca10 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7b041217b0 con 0x7f7b0412ca10 2020-01-26T15:25:48.196 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7b000015d0 con 0x7f7b0412ca10 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 >> v2:172.21.15.129:6791/0 conn(0x7f7b04091390 msgr2=0x7f7b04138b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 --2- 172.21.15.129:0/845572951 >> v2:172.21.15.129:6791/0 conn(0x7f7b04091390 0x7f7b04138b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 >> v1:172.21.15.129:6791/0 conn(0x7f7b04090f60 legacy=0x7f7b04135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 >> v1:172.21.15.129:6789/0 conn(0x7f7b0412ca10 legacy=0x7f7b0412d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7aec003230 con 0x7f7aec00a7f0 2020-01-26T15:25:48.197 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7aec00f450 con 0x7f7aec003c60 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04120880 con 0x7f7aec004090 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388378856 0 0) 0x7f7aec00f450 con 0x7f7aec003c60 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aec00e440 con 0x7f7aec003c60 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892172099 0 0) 0x7f7aec003230 con 0x7f7aec00a7f0 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aec00f450 con 0x7f7aec00a7f0 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 -- 172.21.15.129:0/845572951 >> v1:172.21.15.129:6791/0 conn(0x7f7aec003c60 legacy=0x7f7aec0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.198 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 -- 172.21.15.129:0/845572951 >> v1:172.21.15.129:6790/0 conn(0x7f7aec00a7f0 legacy=0x7f7aec00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b041213b0 con 0x7f7aec004090 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0408fb10 con 0x7f7aec004090 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b04091100 con 0x7f7aec004090 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:48.199 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7af8005880 con 0x7f7aec004090 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8005a80 con 0x7f7aec004090 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7af8012570 con 0x7f7aec004090 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0003360 con 0x7f7aec004090 2020-01-26T15:25:48.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f7af8012770 con 0x7f7aec004090 2020-01-26T15:25:48.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.178+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.182+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f7af804d130 con 0x7f7aec004090 2020-01-26T15:25:48.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.186+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.186+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f7af8033280 con 0x7f7aec004090 2020-01-26T15:25:48.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7ae0003790 con 0x7f7aec004090 2020-01-26T15:25:48.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0a127700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:48.347 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7af77fe700 1 -- 172.21.15.129:0/845572951 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f7af80334e0 con 0x7f7aec004090 2020-01-26T15:25:48.349 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:48.349 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 >> v1:172.21.15.129:6800/16899 conn(0x7f7aec048470 legacy=0x7f7aec04a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 msgr2=0x7f7aec004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0b129700 1 -- 172.21.15.129:0/845572951 reap_dead start 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f7af8000fa0 tx=0x7f7af8010b30).stop 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 shutdown_connections 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 --2- 172.21.15.129:0/845572951 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7aec004090 0x7f7aec004da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:48.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 >> 172.21.15.129:0/845572951 conn(0x7f7b040a5690 msgr2=0x7f7b04123e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:48.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 shutdown_connections 2020-01-26T15:25:48.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:48.342+0000 7f7b0c38b700 1 -- 172.21.15.129:0/845572951 wait complete. 2020-01-26T15:25:48.356 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:51.357 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27fa12a700 1 Processor -- start 2020-01-26T15:25:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27fa12a700 1 -- start start 2020-01-26T15:25:51.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27fa12a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f40a5b80 con 0x7f27f40a5750 2020-01-26T15:25:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27fa12a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f4080440 con 0x7f27f414a880 2020-01-26T15:25:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27fa12a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f40a4e00 con 0x7f27f4146c30 2020-01-26T15:25:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27f8ec8700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f27f414a880 0x7f27f414ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48874/0 (socket says 172.21.15.129:48874) 2020-01-26T15:25:51.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27f8ec8700 1 -- 172.21.15.129:0/3380131580 learned_addr learned my addr 172.21.15.129:0/3380131580 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27f3fff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f27f40a5750 0x7f27f40a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40570/0 (socket says 172.21.15.129:40570) 2020-01-26T15:25:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.470+0000 7f27eb7fe700 1 --1- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6791/0 conn(0x7f27f4146c30 0x7f27f4149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46488/0 (socket says 172.21.15.129:46488) 2020-01-26T15:25:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918253689 0 0) 0x7f27f40a5b80 con 0x7f27f40a5750 2020-01-26T15:25:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e0003230 con 0x7f27f40a5750 2020-01-26T15:25:51.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787263505 0 0) 0x7f27f4080440 con 0x7f27f414a880 2020-01-26T15:25:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f40a5b80 con 0x7f27f414a880 2020-01-26T15:25:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310927352 0 0) 0x7f27f40a4e00 con 0x7f27f4146c30 2020-01-26T15:25:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4080440 con 0x7f27f4146c30 2020-01-26T15:25:51.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3332562396 0 0) 0x7f27e0003230 con 0x7f27f40a5750 2020-01-26T15:25:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6791/0 conn(0x7f27f4146c30 legacy=0x7f27f4149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6790/0 conn(0x7f27f414a880 legacy=0x7f27f414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40a3210 con 0x7f27f40a5750 2020-01-26T15:25:51.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f27e4001710 con 0x7f27f40a5750 2020-01-26T15:25:51.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6789/0 conn(0x7f27f40a5750 legacy=0x7f27f40a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:51.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f27e0003230 con 0x7f27e000ad40 2020-01-26T15:25:51.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f27f40a5b80 con 0x7f27e0003d20 2020-01-26T15:25:51.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e0004150 con 0x7f27e0004da0 2020-01-26T15:25:51.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088454205 0 0) 0x7f27e0003230 con 0x7f27e000ad40 2020-01-26T15:25:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f40a4e00 con 0x7f27e000ad40 2020-01-26T15:25:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473619595 0 0) 0x7f27f40a5b80 con 0x7f27e0003d20 2020-01-26T15:25:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e0003230 con 0x7f27e0003d20 2020-01-26T15:25:51.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 -- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6791/0 conn(0x7f27e0003d20 legacy=0x7f27e00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 -- 172.21.15.129:0/3380131580 >> v1:172.21.15.129:6790/0 conn(0x7f27e000ad40 legacy=0x7f27e000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 -- 172.21.15.129:0/3380131580 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e000e990 con 0x7f27e0004da0 2020-01-26T15:25:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:51.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).ready entity=mon.0 client_cookie=ba0469c387686902 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f27dc010b30 con 0x7f27e0004da0 2020-01-26T15:25:51.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27eb7fe700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc010d30 con 0x7f27e0004da0 2020-01-26T15:25:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27f37fe700 1 -- 172.21.15.129:0/3380131580 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f27dc0056d0 con 0x7f27e0004da0 2020-01-26T15:25:51.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 -- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 msgr2=0x7f27e000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f27dc0010d0 tx=0x7f27dc00fe80).stop 2020-01-26T15:25:51.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 -- 172.21.15.129:0/3380131580 shutdown_connections 2020-01-26T15:25:51.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 --2- 172.21.15.129:0/3380131580 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f27e0004da0 0x7f27e000a7f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:51.495 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 -- 172.21.15.129:0/3380131580 >> 172.21.15.129:0/3380131580 conn(0x7f27f405e050 msgr2=0x7f27f4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:51.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 -- 172.21.15.129:0/3380131580 shutdown_connections 2020-01-26T15:25:51.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.474+0000 7f27fa12a700 1 -- 172.21.15.129:0/3380131580 wait complete. 2020-01-26T15:25:51.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 Processor -- start 2020-01-26T15:25:51.496 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- start start 2020-01-26T15:25:51.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 0x7f27f4065b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:51.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 0x7f27f4062650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:51.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f4066090 con 0x7f27f411f040 2020-01-26T15:25:51.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f27f411cef0 con 0x7f27f407cbf0 2020-01-26T15:25:51.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f27f4063230 con 0x7f27f411ec10 2020-01-26T15:25:51.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27eb7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 0x7f27f4062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:51.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27eb7fe700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 0x7f27f4062650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:51.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f8ec8700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f27f411f040 0x7f27f4130d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48886/0 (socket says 172.21.15.129:48886) 2020-01-26T15:25:51.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f8ec8700 1 -- 172.21.15.129:0/2696913446 learned_addr learned my addr 172.21.15.129:0/2696913446 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:51.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f3fff700 -1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 0x7f27f4065b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:51.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f3fff700 1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 0x7f27f4065b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:51.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454760294 0 0) 0x7f27f40a4e00 con 0x7f27f411f040 2020-01-26T15:25:51.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d8003230 con 0x7f27f411f040 2020-01-26T15:25:51.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 112443669 0 0) 0x7f27d8003230 con 0x7f27f411f040 2020-01-26T15:25:51.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27f40a4e00 con 0x7f27f411f040 2020-01-26T15:25:51.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f27ec001670 con 0x7f27f411f040 2020-01-26T15:25:51.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1376050097 0 0) 0x7f27f40a4e00 con 0x7f27f411f040 2020-01-26T15:25:51.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 msgr2=0x7f27f4062650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:51.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 0x7f27f4062650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:51.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 msgr2=0x7f27f4065b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:51.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 0x7f27f4065b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:51.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4120920 con 0x7f27f411f040 2020-01-26T15:25:51.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f411e1b0 con 0x7f27f411f040 2020-01-26T15:25:51.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4062ba0 con 0x7f27f411f040 2020-01-26T15:25:51.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f27ec004b20 con 0x7f27f411f040 2020-01-26T15:25:51.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.478+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f27ec004ec0 con 0x7f27f411f040 2020-01-26T15:25:51.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.482+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc003360 con 0x7f27f411f040 2020-01-26T15:25:51.507 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.482+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f27ec010900 con 0x7f27f411f040 2020-01-26T15:25:51.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.482+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f27f4066090 con 0x7f27f411f040 2020-01-26T15:25:51.508 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.486+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f27ec031450 con 0x7f27f411f040 2020-01-26T15:25:51.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.646+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f27cc0037d0 con 0x7f27f411f040 2020-01-26T15:25:51.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.646+0000 7f27f17fa700 1 -- 172.21.15.129:0/2696913446 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f27ec04aba0 con 0x7f27f411f040 2020-01-26T15:25:51.649 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:51.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 >> v1:172.21.15.129:6800/16899 conn(0x7f27d803e020 legacy=0x7f27d8040530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 >> v1:172.21.15.129:6790/0 conn(0x7f27f411f040 legacy=0x7f27f4130d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:51.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 shutdown_connections 2020-01-26T15:25:51.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6790/0 conn(0x7f27f407cbf0 0x7f27f4065b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:51.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 --2- 172.21.15.129:0/2696913446 >> v2:172.21.15.129:6791/0 conn(0x7f27f411ec10 0x7f27f4062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:51.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 >> 172.21.15.129:0/2696913446 conn(0x7f27f40a45e0 msgr2=0x7f27f4123560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:51.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 shutdown_connections 2020-01-26T15:25:51.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:51.650+0000 7f27fa12a700 1 -- 172.21.15.129:0/2696913446 wait complete. 2020-01-26T15:25:51.669 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:54.669 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:54.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 Processor -- start 2020-01-26T15:25:54.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 -- start start 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 0x7f65f814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f80a5b80 con 0x7f65f80a5750 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f8080440 con 0x7f65f8146c30 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f65f80a43f0 con 0x7f65f814a880 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f7fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 0x7f65f814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:54.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f77fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f65f80a5750 0x7f65f80a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48890/0 (socket says 172.21.15.129:48890) 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f77fe700 1 -- 172.21.15.129:0/1554108962 learned_addr learned my addr 172.21.15.129:0/1554108962 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f6ffd700 1 --1- 172.21.15.129:0/1554108962 >> v1:172.21.15.129:6791/0 conn(0x7f65f8146c30 0x7f65f8149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46510/0 (socket says 172.21.15.129:46510) 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f7fff700 1 --2- 172.21.15.129:0/1554108962 >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 0x7f65f814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820987182 0 0) 0x7f65f80a5b80 con 0x7f65f80a5750 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e4003230 con 0x7f65f80a5750 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138769513 0 0) 0x7f65f8080440 con 0x7f65f8146c30 2020-01-26T15:25:54.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f80a5b80 con 0x7f65f8146c30 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2165071224 0 0) 0x7f65e4003230 con 0x7f65f80a5750 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 msgr2=0x7f65f814ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 --2- 172.21.15.129:0/1554108962 >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 0x7f65f814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 >> v1:172.21.15.129:6791/0 conn(0x7f65f8146c30 legacy=0x7f65f8149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80a4e00 con 0x7f65f80a5750 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f65f0001a90 con 0x7f65f80a5750 2020-01-26T15:25:54.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f65f0001d50 con 0x7f65f80a5750 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65fd88f700 1 -- 172.21.15.129:0/1554108962 >> v1:172.21.15.129:6790/0 conn(0x7f65f80a5750 legacy=0x7f65f80a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.786+0000 7f65f67fc700 1 -- 172.21.15.129:0/1554108962 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f65f0004930 con 0x7f65f80a5750 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- 172.21.15.129:0/1554108962 shutdown_connections 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 --2- 172.21.15.129:0/1554108962 >> v2:172.21.15.129:6790/0 conn(0x7f65f814a880 0x7f65f814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- 172.21.15.129:0/1554108962 >> 172.21.15.129:0/1554108962 conn(0x7f65f805e050 msgr2=0x7f65f8098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- 172.21.15.129:0/1554108962 shutdown_connections 2020-01-26T15:25:54.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- 172.21.15.129:0/1554108962 wait complete. 2020-01-26T15:25:54.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 Processor -- start 2020-01-26T15:25:54.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- start start 2020-01-26T15:25:54.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f65f809fa40 0x7f65f8060220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:54.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f809ec00 con 0x7f65f8060770 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f812daf0 con 0x7f65f8073930 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65fd88f700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f65f8095390 con 0x7f65f809fa40 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65f77fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f65f809fa40 0x7f65f8060220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65f7fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f65f8073930 0x7f65f8075d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48896/0 (socket says 172.21.15.129:48896) 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65f7fff700 1 -- 172.21.15.129:0/1413898271 learned_addr learned my addr 172.21.15.129:0/1413898271 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> v2:172.21.15.129:6791/0 conn(0x7f65f809fa40 0x7f65f8060220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:54.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.790+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858132523 0 0) 0x7f65f812daf0 con 0x7f65f8073930 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc003230 con 0x7f65f8073930 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207409917 0 0) 0x7f65f809ec00 con 0x7f65f8060770 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f812daf0 con 0x7f65f8060770 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2049280783 0 0) 0x7f65dc003230 con 0x7f65f8073930 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65f809ec00 con 0x7f65f8073930 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f65e80026f0 con 0x7f65f8073930 2020-01-26T15:25:54.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1608996970 0 0) 0x7f65f812daf0 con 0x7f65f8060770 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f65dc003230 con 0x7f65f8060770 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f65e0001790 con 0x7f65f8060770 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 >> v2:172.21.15.129:6791/0 conn(0x7f65f809fa40 msgr2=0x7f65f8060220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 --2- 172.21.15.129:0/1413898271 >> v2:172.21.15.129:6791/0 conn(0x7f65f809fa40 0x7f65f8060220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 >> v1:172.21.15.129:6790/0 conn(0x7f65f8073930 legacy=0x7f65f8075d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 >> v1:172.21.15.129:6789/0 conn(0x7f65f8060770 legacy=0x7f65f812d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f65f812daf0 con 0x7f65dc003a90 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f65dc00f820 con 0x7f65dc003ec0 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8095390 con 0x7f65dc004f00 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 -- 172.21.15.129:0/1413898271 >> v1:172.21.15.129:6791/0 conn(0x7f65dc003ec0 legacy=0x7f65dc00d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 -- 172.21.15.129:0/1413898271 >> v1:172.21.15.129:6790/0 conn(0x7f65dc003a90 legacy=0x7f65dc0097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f65f809e8b0 con 0x7f65dc004f00 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f8094b70 con 0x7f65dc004f00 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f8073930 con 0x7f65dc004f00 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f65f000cb00 con 0x7f65dc004f00 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000cd00 con 0x7f65dc004f00 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0003360 con 0x7f65dc004f00 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.794+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.798+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f65f0010260 con 0x7f65dc004f00 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.798+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.798+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f65f004cfc0 con 0x7f65dc004f00 2020-01-26T15:25:54.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.802+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.802+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f65f0033170 con 0x7f65dc004f00 2020-01-26T15:25:54.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f65d00036b0 con 0x7f65dc004f00 2020-01-26T15:25:54.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65f77fe700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:25:54.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65effff700 1 -- 172.21.15.129:0/1413898271 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f65f00333d0 con 0x7f65dc004f00 2020-01-26T15:25:54.963 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:54.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 >> v1:172.21.15.129:6800/16899 conn(0x7f65dc048560 legacy=0x7f65dc04aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 msgr2=0x7f65dc003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:54.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65f7fff700 1 -- 172.21.15.129:0/1413898271 reap_dead start 2020-01-26T15:25:54.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f65f0001880 tx=0x7f65f0010dc0).stop 2020-01-26T15:25:54.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 shutdown_connections 2020-01-26T15:25:54.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 --2- 172.21.15.129:0/1413898271 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f65dc004f00 0x7f65dc003540 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:54.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 >> 172.21.15.129:0/1413898271 conn(0x7f65f80a4110 msgr2=0x7f65f80a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:54.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 shutdown_connections 2020-01-26T15:25:54.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:54.962+0000 7f65fd88f700 1 -- 172.21.15.129:0/1413898271 wait complete. 2020-01-26T15:25:54.975 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:25:57.978 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:25:58.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 Processor -- start 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 -- start start 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 0x7fa4bc05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc098000 con 0x7fa4bc0a6870 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc05e050 con 0x7fa4bc149040 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bb59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc0a6ca0 con 0x7fa4bc05edd0 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4b3fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fa4bc0a6870 0x7fa4bc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48910/0 (socket says 172.21.15.129:48910) 2020-01-26T15:25:58.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4b3fff700 1 -- 172.21.15.129:0/3419796143 learned_addr learned my addr 172.21.15.129:0/3419796143 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bad9d700 -1 --2- 172.21.15.129:0/3419796143 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 0x7fa4bc05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4bad9d700 1 --2- 172.21.15.129:0/3419796143 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 0x7fa4bc05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477326623 0 0) 0x7fa4bc098000 con 0x7fa4bc0a6870 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa49c003230 con 0x7fa4bc0a6870 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405037781 0 0) 0x7fa4bc05e050 con 0x7fa4bc149040 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc098000 con 0x7fa4bc149040 2020-01-26T15:25:58.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 980435402 0 0) 0x7fa49c003230 con 0x7fa4bc0a6870 2020-01-26T15:25:58.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 msgr2=0x7fa4bc05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:25:58.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 --2- 172.21.15.129:0/3419796143 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 0x7fa4bc05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:58.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 >> v1:172.21.15.129:6791/0 conn(0x7fa4bc149040 legacy=0x7fa4bc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:58.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.094+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc14ecb0 con 0x7fa4bc0a6870 2020-01-26T15:25:58.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa4a4001710 con 0x7fa4bc0a6870 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa4a40019e0 con 0x7fa4bc0a6870 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4ba59c700 1 -- 172.21.15.129:0/3419796143 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa4a40045b0 con 0x7fa4bc0a6870 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 -- 172.21.15.129:0/3419796143 >> v1:172.21.15.129:6790/0 conn(0x7fa4bc0a6870 legacy=0x7fa4bc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 -- 172.21.15.129:0/3419796143 shutdown_connections 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 --2- 172.21.15.129:0/3419796143 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc05edd0 0x7fa4bc05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 -- 172.21.15.129:0/3419796143 >> 172.21.15.129:0/3419796143 conn(0x7fa4bc098e70 msgr2=0x7fa4bc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 -- 172.21.15.129:0/3419796143 shutdown_connections 2020-01-26T15:25:58.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.098+0000 7fa4bb59e700 1 -- 172.21.15.129:0/3419796143 wait complete. 2020-01-26T15:25:58.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 Processor -- start 2020-01-26T15:25:58.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- start start 2020-01-26T15:25:58.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 0x7fa4bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:58.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 0x7fa4bc138760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:25:58.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0a3ee0 con 0x7fa4bc12de20 2020-01-26T15:25:58.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc067b30 con 0x7fa4bc120990 2020-01-26T15:25:58.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa4bc11fb80 con 0x7fa4bc136320 2020-01-26T15:25:58.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bad9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 0x7fa4bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bad9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 0x7fa4bc0a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4c0a6e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 0x7fa4bc138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4c0a6e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 0x7fa4bc138760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b3fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fa4bc12de20 0x7fa4bc12e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48918/0 (socket says 172.21.15.129:48918) 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b3fff700 1 -- 172.21.15.129:0/346149411 learned_addr learned my addr 172.21.15.129:0/346149411 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219859639 0 0) 0x7fa4bc0a3ee0 con 0x7fa4bc12de20 2020-01-26T15:25:58.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa494003230 con 0x7fa4bc12de20 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3214151843 0 0) 0x7fa494003230 con 0x7fa4bc12de20 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa4bc0a3ee0 con 0x7fa4bc12de20 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa4a4001420 con 0x7fa4bc12de20 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2472318452 0 0) 0x7fa4bc0a3ee0 con 0x7fa4bc12de20 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 msgr2=0x7fa4bc138760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 --2- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 0x7fa4bc138760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 msgr2=0x7fa4bc0a3990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:25:58.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 --2- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 0x7fa4bc0a3990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc097e00 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0a1670 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc120dc0 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa4a4004ab0 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.102+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa4a4004e50 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.106+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa498003360 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.106+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fa4a4010890 con 0x7fa4bc12de20 2020-01-26T15:25:58.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.106+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fa4a404bbc0 con 0x7fa4bc12de20 2020-01-26T15:25:58.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.110+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fa4a4030e80 con 0x7fa4bc12de20 2020-01-26T15:25:58.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.266+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa4980037d0 con 0x7fa4bc12de20 2020-01-26T15:25:58.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.266+0000 7fa4b37fe700 1 -- 172.21.15.129:0/346149411 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fa4a40310e0 con 0x7fa4bc12de20 2020-01-26T15:25:58.268 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:25:58.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 >> v1:172.21.15.129:6800/16899 conn(0x7fa49403dfb0 legacy=0x7fa4940404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:58.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 >> v1:172.21.15.129:6790/0 conn(0x7fa4bc12de20 legacy=0x7fa4bc12e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:25:58.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 shutdown_connections 2020-01-26T15:25:58.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 --2- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6791/0 conn(0x7fa4bc136320 0x7fa4bc138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:58.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 --2- 172.21.15.129:0/346149411 >> v2:172.21.15.129:6790/0 conn(0x7fa4bc120990 0x7fa4bc0a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:25:58.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 >> 172.21.15.129:0/346149411 conn(0x7fa4bc05edd0 msgr2=0x7fa4bc07efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:25:58.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 shutdown_connections 2020-01-26T15:25:58.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:25:58.270+0000 7fa4bb59e700 1 -- 172.21.15.129:0/346149411 wait complete. 2020-01-26T15:25:58.281 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:01.282 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 Processor -- start 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 -- start start 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840a43f0 con 0x7fa884080440 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840a4f20 con 0x7fa8840a32d0 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840a0b50 con 0x7fa8840a4af0 2020-01-26T15:26:01.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa888ac1700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fa884080440 0x7fa88405eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40624/0 (socket says 172.21.15.129:40624) 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa888ac1700 1 -- 172.21.15.129:0/3978270385 learned_addr learned my addr 172.21.15.129:0/3978270385 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657044251 0 0) 0x7fa8840a0b50 con 0x7fa8840a4af0 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa864003230 con 0x7fa8840a4af0 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679894576 0 0) 0x7fa8740010d0 con 0x7fa8840a32d0 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8840a0b50 con 0x7fa8840a32d0 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325836902 0 0) 0x7fa8840a43f0 con 0x7fa884080440 2020-01-26T15:26:01.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8740010d0 con 0x7fa884080440 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4136723335 0 0) 0x7fa864003230 con 0x7fa8840a4af0 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 >> v1:172.21.15.129:6790/0 conn(0x7fa8840a32d0 legacy=0x7fa88405f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 >> v1:172.21.15.129:6789/0 conn(0x7fa884080440 legacy=0x7fa88405eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88405b180 con 0x7fa8840a4af0 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa86c001710 con 0x7fa8840a4af0 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa86c001910 con 0x7fa8840a4af0 2020-01-26T15:26:01.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa8837fe700 1 -- 172.21.15.129:0/3978270385 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa86c001d30 con 0x7fa8840a4af0 2020-01-26T15:26:01.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.402+0000 7fa88a524700 1 -- 172.21.15.129:0/3978270385 >> v1:172.21.15.129:6791/0 conn(0x7fa8840a4af0 legacy=0x7fa88414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- 172.21.15.129:0/3978270385 shutdown_connections 2020-01-26T15:26:01.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- 172.21.15.129:0/3978270385 >> 172.21.15.129:0/3978270385 conn(0x7fa884098160 msgr2=0x7fa88405e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:01.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- 172.21.15.129:0/3978270385 shutdown_connections 2020-01-26T15:26:01.409 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- 172.21.15.129:0/3978270385 wait complete. 2020-01-26T15:26:01.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 Processor -- start 2020-01-26T15:26:01.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- start start 2020-01-26T15:26:01.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 0x7fa88415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:01.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa884094610 con 0x7fa8841415c0 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa884141000 con 0x7fa88413ef80 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa88a524700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fa8841419f0 con 0x7fa88413f3b0 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa888ac1700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fa8841415c0 0x7fa884140020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48930/0 (socket says 172.21.15.129:48930) 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa888ac1700 1 -- 172.21.15.129:0/1509260212 learned_addr learned my addr 172.21.15.129:0/1509260212 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8892c2700 -1 --2- 172.21.15.129:0/1509260212 >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 0x7fa88415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8892c2700 1 --2- 172.21.15.129:0/1509260212 >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 0x7fa88415d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:01.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414959352 0 0) 0x7fa884094610 con 0x7fa8841415c0 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c003230 con 0x7fa8841415c0 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734158206 0 0) 0x7fa884141000 con 0x7fa88413ef80 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa884094610 con 0x7fa88413ef80 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2089833633 0 0) 0x7fa884094610 con 0x7fa88413ef80 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa884141000 con 0x7fa88413ef80 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa874001810 con 0x7fa88413ef80 2020-01-26T15:26:01.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.406+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1218795269 0 0) 0x7fa85c003230 con 0x7fa8841415c0 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa884094610 con 0x7fa8841415c0 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa87c001c90 con 0x7fa8841415c0 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3676227763 0 0) 0x7fa884141000 con 0x7fa88413ef80 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 msgr2=0x7fa88415d9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 --2- 172.21.15.129:0/1509260212 >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 0x7fa88415d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:01.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 >> v1:172.21.15.129:6790/0 conn(0x7fa8841415c0 legacy=0x7fa884140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884093ae0 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840a2910 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88415df40 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa874001ae0 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fa874001f00 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fa874002180 con 0x7fa88413ef80 2020-01-26T15:26:01.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860003360 con 0x7fa88413ef80 2020-01-26T15:26:01.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.410+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fa8840a4f20 con 0x7fa88413ef80 2020-01-26T15:26:01.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.414+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fa87402e7e0 con 0x7fa88413ef80 2020-01-26T15:26:01.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.574+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa8600037d0 con 0x7fa88413ef80 2020-01-26T15:26:01.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.574+0000 7fa8817fa700 1 -- 172.21.15.129:0/1509260212 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fa874047ed0 con 0x7fa88413ef80 2020-01-26T15:26:01.576 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:01.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 >> v1:172.21.15.129:6800/16899 conn(0x7fa85c03e470 legacy=0x7fa85c040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 >> v1:172.21.15.129:6791/0 conn(0x7fa88413ef80 legacy=0x7fa88407f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:01.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 shutdown_connections 2020-01-26T15:26:01.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 --2- 172.21.15.129:0/1509260212 >> v2:172.21.15.129:6791/0 conn(0x7fa88413f3b0 0x7fa88415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:01.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 >> 172.21.15.129:0/1509260212 conn(0x7fa8840a7120 msgr2=0x7fa8840a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:01.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 shutdown_connections 2020-01-26T15:26:01.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:01.578+0000 7fa88a524700 1 -- 172.21.15.129:0/1509260212 wait complete. 2020-01-26T15:26:01.589 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:04.590 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 Processor -- start 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 -- start start 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 0x7f63c00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00a6dc0 con 0x7f63c0149040 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c005ea20 con 0x7f63c005edd0 2020-01-26T15:26:04.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63bffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f63c0098000 con 0x7f63c005e5f0 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63c5740700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f63c0149040 0x7f63c014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48942/0 (socket says 172.21.15.129:48942) 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63c5740700 1 -- 172.21.15.129:0/2844082898 learned_addr learned my addr 172.21.15.129:0/2844082898 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63beffd700 -1 --2- 172.21.15.129:0/2844082898 >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 0x7f63c00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63beffd700 1 --2- 172.21.15.129:0/2844082898 >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 0x7f63c00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860806317 0 0) 0x7f63c005ea20 con 0x7f63c005edd0 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003230 con 0x7f63c005edd0 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557028553 0 0) 0x7f63c00a6dc0 con 0x7f63c0149040 2020-01-26T15:26:04.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.706+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c005ea20 con 0x7f63c0149040 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 659089507 0 0) 0x7f63a8003230 con 0x7f63c005edd0 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 msgr2=0x7f63c00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 --2- 172.21.15.129:0/2844082898 >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 0x7f63c00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 >> v1:172.21.15.129:6790/0 conn(0x7f63c0149040 legacy=0x7f63c014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c005e050 con 0x7f63c005edd0 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63b0001710 con 0x7f63c005edd0 2020-01-26T15:26:04.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f63b0001910 con 0x7f63c005edd0 2020-01-26T15:26:04.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63be7fc700 1 -- 172.21.15.129:0/2844082898 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63b0001ec0 con 0x7f63c005edd0 2020-01-26T15:26:04.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- 172.21.15.129:0/2844082898 >> v1:172.21.15.129:6791/0 conn(0x7f63c005edd0 legacy=0x7f63c007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- 172.21.15.129:0/2844082898 shutdown_connections 2020-01-26T15:26:04.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 --2- 172.21.15.129:0/2844082898 >> v2:172.21.15.129:6791/0 conn(0x7f63c005e5f0 0x7f63c00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:04.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- 172.21.15.129:0/2844082898 >> 172.21.15.129:0/2844082898 conn(0x7f63c0098e70 msgr2=0x7f63c00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:04.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- 172.21.15.129:0/2844082898 shutdown_connections 2020-01-26T15:26:04.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- 172.21.15.129:0/2844082898 wait complete. 2020-01-26T15:26:04.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 Processor -- start 2020-01-26T15:26:04.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.710+0000 7f63bffff700 1 -- start start 2020-01-26T15:26:04.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f63c0120720 0x7f63c009dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:04.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f63c0121200 0x7f63c007b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:04.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bffff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0121630 con 0x7f63c00247b0 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f63c0099270 con 0x7f63c0121200 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f63c007b110 con 0x7f63c0120720 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bf7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f63c0120720 0x7f63c009dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63c5740700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f63c00247b0 0x7f63c0024be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40648/0 (socket says 172.21.15.129:40648) 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63c5740700 1 -- 172.21.15.129:0/485026056 learned_addr learned my addr 172.21.15.129:0/485026056 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63bf7fe700 1 --2- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6791/0 conn(0x7f63c0120720 0x7f63c009dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:04.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63beffd700 -1 --2- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6790/0 conn(0x7f63c0121200 0x7f63c007b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63beffd700 1 --2- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6790/0 conn(0x7f63c0121200 0x7f63c007b5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631562274 0 0) 0x7f63c0121630 con 0x7f63c00247b0 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003230 con 0x7f63c00247b0 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2279136039 0 0) 0x7f63a0003230 con 0x7f63c00247b0 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63c0121630 con 0x7f63c00247b0 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63b8001ba0 con 0x7f63c00247b0 2020-01-26T15:26:04.725 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6791/0 conn(0x7f63c0120720 msgr2=0x7f63c009dfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 --2- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6791/0 conn(0x7f63c0120720 0x7f63c009dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6790/0 conn(0x7f63c0121200 msgr2=0x7f63c007b5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 --2- 172.21.15.129:0/485026056 >> v2:172.21.15.129:6790/0 conn(0x7f63c0121200 0x7f63c007b5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 >> v1:172.21.15.129:6789/0 conn(0x7f63c00247b0 legacy=0x7f63c0024be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f63a0003230 con 0x7f63a0003aa0 2020-01-26T15:26:04.726 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f63a000f3b0 con 0x7f63a0003f50 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0099270 con 0x7f63a000b800 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267642081 0 0) 0x7f63a0003230 con 0x7f63a0003aa0 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a000f5e0 con 0x7f63a0003aa0 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318817363 0 0) 0x7f63a000f3b0 con 0x7f63a0003f50 2020-01-26T15:26:04.727 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003230 con 0x7f63a0003f50 2020-01-26T15:26:04.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 96998395 0 0) 0x7f63a000f5e0 con 0x7f63a0003aa0 2020-01-26T15:26:04.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63a000f3b0 con 0x7f63a0003aa0 2020-01-26T15:26:04.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63b0001aa0 con 0x7f63a0003aa0 2020-01-26T15:26:04.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1153751207 0 0) 0x7f63a0003230 con 0x7f63a0003f50 2020-01-26T15:26:04.728 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63a000f5e0 con 0x7f63a0003f50 2020-01-26T15:26:04.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f63b4002630 con 0x7f63a0003f50 2020-01-26T15:26:04.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4198018463 0 0) 0x7f63a000f3b0 con 0x7f63a0003aa0 2020-01-26T15:26:04.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63c5740700 1 -- 172.21.15.129:0/485026056 >> v1:172.21.15.129:6791/0 conn(0x7f63a0003f50 legacy=0x7f63a0004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.714+0000 7f63c5740700 1 -- 172.21.15.129:0/485026056 >> v1:172.21.15.129:6790/0 conn(0x7f63a0003aa0 legacy=0x7f63a00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.729 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c007bb30 con 0x7f63a000b800 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 -- 172.21.15.129:0/485026056 reap_dead start 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c00253e0 con 0x7f63a000b800 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c01213a0 con 0x7f63a000b800 2020-01-26T15:26:04.730 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f63b8005ad0 con 0x7f63a000b800 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8005cd0 con 0x7f63a000b800 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f63b800e310 con 0x7f63a000b800 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f63b8012cf0 con 0x7f63a000b800 2020-01-26T15:26:04.731 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6398003360 con 0x7f63a000b800 2020-01-26T15:26:04.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.718+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f63b804da30 con 0x7f63a000b800 2020-01-26T15:26:04.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.722+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.732 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.722+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f63b8033b80 con 0x7f63a000b800 2020-01-26T15:26:04.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6398003790 con 0x7f63a000b800 2020-01-26T15:26:04.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63c5740700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:04.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63a7fff700 1 -- 172.21.15.129:0/485026056 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f63b8033de0 con 0x7f63a000b800 2020-01-26T15:26:04.882 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:04.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 >> v1:172.21.15.129:6800/16899 conn(0x7f63a0041000 legacy=0x7f63a0043510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 msgr2=0x7f63a000dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:04.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f63b8001330 tx=0x7f63b0001830).stop 2020-01-26T15:26:04.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 shutdown_connections 2020-01-26T15:26:04.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 --2- 172.21.15.129:0/485026056 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f63a000b800 0x7f63a000dca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:04.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 >> 172.21.15.129:0/485026056 conn(0x7f63c007f660 msgr2=0x7f63c0122390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:04.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 shutdown_connections 2020-01-26T15:26:04.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:04.882+0000 7f63bffff700 1 -- 172.21.15.129:0/485026056 wait complete. 2020-01-26T15:26:04.894 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:07.895 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:08.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb711ff6700 1 Processor -- start 2020-01-26T15:26:08.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb711ff6700 1 -- start start 2020-01-26T15:26:08.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb711ff6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c05ea20 con 0x7fb70c0a6870 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb711ff6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c098000 con 0x7fb70c05e5f0 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb711ff6700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c05e050 con 0x7fb70c05edd0 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb710ff4700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb70c05e5f0 0x7fb70c149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48958/0 (socket says 172.21.15.129:48958) 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb710ff4700 1 -- 172.21.15.129:0/778350709 learned_addr learned my addr 172.21.15.129:0/778350709 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109690759 0 0) 0x7fb70c05e050 con 0x7fb70c05edd0 2020-01-26T15:26:08.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f8003230 con 0x7fb70c05edd0 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037813741 0 0) 0x7fb70c05ea20 con 0x7fb70c0a6870 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c05e050 con 0x7fb70c0a6870 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307404143 0 0) 0x7fb70c098000 con 0x7fb70c05e5f0 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.014+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c05ea20 con 0x7fb70c05e5f0 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2521254960 0 0) 0x7fb6f8003230 con 0x7fb70c05edd0 2020-01-26T15:26:08.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 >> v1:172.21.15.129:6790/0 conn(0x7fb70c05e5f0 legacy=0x7fb70c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 >> v1:172.21.15.129:6789/0 conn(0x7fb70c0a6870 legacy=0x7fb70c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0a6ca0 con 0x7fb70c05edd0 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb708001640 con 0x7fb70c05edd0 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb708001840 con 0x7fb70c05edd0 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb6fffff700 1 -- 172.21.15.129:0/778350709 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb708001c60 con 0x7fb70c05edd0 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- 172.21.15.129:0/778350709 >> v1:172.21.15.129:6791/0 conn(0x7fb70c05edd0 legacy=0x7fb70c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- 172.21.15.129:0/778350709 shutdown_connections 2020-01-26T15:26:08.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- 172.21.15.129:0/778350709 >> 172.21.15.129:0/778350709 conn(0x7fb70c098e70 msgr2=0x7fb70c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:08.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- 172.21.15.129:0/778350709 shutdown_connections 2020-01-26T15:26:08.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- 172.21.15.129:0/778350709 wait complete. 2020-01-26T15:26:08.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 Processor -- start 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- start start 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb70c09f4b0 0x7fb70c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c0a1ae0 con 0x7fb70c099fe0 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c09f8e0 con 0x7fb70c09a410 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb711ff6700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb70c144e00 con 0x7fb70c09f4b0 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb713258700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb70c09f4b0 0x7fb70c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:08.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb713258700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb70c09f4b0 0x7fb70c15b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb710ff4700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb70c09a410 0x7fb70c09ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48966/0 (socket says 172.21.15.129:48966) 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb7117f5700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb70c099fe0 0x7fb70c07cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40664/0 (socket says 172.21.15.129:40664) 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.018+0000 7fb710ff4700 1 -- 172.21.15.129:0/1500284332 learned_addr learned my addr 172.21.15.129:0/1500284332 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951486321 0 0) 0x7fb70c0a1ae0 con 0x7fb70c099fe0 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ec003230 con 0x7fb70c099fe0 2020-01-26T15:26:08.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800756068 0 0) 0x7fb70c09f8e0 con 0x7fb70c09a410 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c0a1ae0 con 0x7fb70c09a410 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1965775386 0 0) 0x7fb6ec003230 con 0x7fb70c099fe0 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb70c09f8e0 con 0x7fb70c099fe0 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb708001a90 con 0x7fb70c099fe0 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 >> v2:172.21.15.129:6791/0 conn(0x7fb70c09f4b0 msgr2=0x7fb70c15b790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 --2- 172.21.15.129:0/1500284332 >> v2:172.21.15.129:6791/0 conn(0x7fb70c09f4b0 0x7fb70c15b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:08.030 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 >> v1:172.21.15.129:6790/0 conn(0x7fb70c09a410 legacy=0x7fb70c09ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 >> v1:172.21.15.129:6789/0 conn(0x7fb70c099fe0 legacy=0x7fb70c07cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb6ec003230 con 0x7fb6ec004c90 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb6ec00f430 con 0x7fb6ec0050c0 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c144e00 con 0x7fb6ec00b860 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:08.031 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136033950 0 0) 0x7fb6ec00f430 con 0x7fb6ec0050c0 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ec00e420 con 0x7fb6ec0050c0 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102310682 0 0) 0x7fb6ec003230 con 0x7fb6ec004c90 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ec00f430 con 0x7fb6ec004c90 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1837976819 0 0) 0x7fb6ec00e420 con 0x7fb6ec0050c0 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6ec003230 con 0x7fb6ec0050c0 2020-01-26T15:26:08.032 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb700001a10 con 0x7fb6ec0050c0 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 -- 172.21.15.129:0/1500284332 >> v1:172.21.15.129:6791/0 conn(0x7fb6ec0050c0 legacy=0x7fb6ec003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 -- 172.21.15.129:0/1500284332 >> v1:172.21.15.129:6790/0 conn(0x7fb6ec004c90 legacy=0x7fb6ec003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c07d6f0 con 0x7fb6ec00b860 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c1448b0 con 0x7fb6ec00b860 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c09a5b0 con 0x7fb6ec00b860 2020-01-26T15:26:08.033 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb704006730 con 0x7fb6ec00b860 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb704006930 con 0x7fb6ec00b860 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb704006d90 con 0x7fb6ec00b860 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e4003360 con 0x7fb6ec00b860 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fb704003160 con 0x7fb6ec00b860 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.022+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.026+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fb70404d6f0 con 0x7fb6ec00b860 2020-01-26T15:26:08.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.030+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.030+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fb704033aa0 con 0x7fb6ec00b860 2020-01-26T15:26:08.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6e4003790 con 0x7fb6ec00b860 2020-01-26T15:26:08.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb713258700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:08.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb6fdffb700 1 -- 172.21.15.129:0/1500284332 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb704003b00 con 0x7fb6ec00b860 2020-01-26T15:26:08.187 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:08.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 >> v1:172.21.15.129:6800/16899 conn(0x7fb6ec048680 legacy=0x7fb6ec04ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 msgr2=0x7fb6ec00dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb713258700 1 -- 172.21.15.129:0/1500284332 reap_dead start 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fb70400c3f0 tx=0x7fb704010cd0).stop 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 shutdown_connections 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 --2- 172.21.15.129:0/1500284332 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb6ec00b860 0x7fb6ec00dd70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 >> 172.21.15.129:0/1500284332 conn(0x7fb70c0a5520 msgr2=0x7fb70c145980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 shutdown_connections 2020-01-26T15:26:08.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:08.186+0000 7fb711ff6700 1 -- 172.21.15.129:0/1500284332 wait complete. 2020-01-26T15:26:08.199 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:11.200 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:11.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.310+0000 7f0199399700 1 Processor -- start 2020-01-26T15:26:11.317 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.310+0000 7f0199399700 1 -- start start 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 0x7f019405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 0x7f019414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0194098000 con 0x7f01940a6870 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f019405e050 con 0x7f0194149040 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f01940a6ca0 con 0x7f019405edd0 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0198b98700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 0x7f019405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:11.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f019a5fb700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 0x7f019414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0193fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f01940a6870 0x7f019407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:48978/0 (socket says 172.21.15.129:48978) 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0193fff700 1 -- 172.21.15.129:0/2745065863 learned_addr learned my addr 172.21.15.129:0/2745065863 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0198b98700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 0x7f019405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f019a5fb700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 0x7f019414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999224653 0 0) 0x7f0194098000 con 0x7f01940a6870 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0180003230 con 0x7f01940a6870 2020-01-26T15:26:11.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1790818086 0 0) 0x7f0180003230 con 0x7f01940a6870 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 msgr2=0x7f019405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 0x7f019405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 msgr2=0x7f019414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 0x7f019414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019414c9e0 con 0x7f01940a6870 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f017c001710 con 0x7f01940a6870 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f017c001910 con 0x7f01940a6870 2020-01-26T15:26:11.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f01937fe700 1 -- 172.21.15.129:0/2745065863 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f017c0045b0 con 0x7f01940a6870 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- 172.21.15.129:0/2745065863 >> v1:172.21.15.129:6790/0 conn(0x7f01940a6870 legacy=0x7f019407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- 172.21.15.129:0/2745065863 shutdown_connections 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6790/0 conn(0x7f0194149040 0x7f019414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 --2- 172.21.15.129:0/2745065863 >> v2:172.21.15.129:6791/0 conn(0x7f019405edd0 0x7f019405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- 172.21.15.129:0/2745065863 >> 172.21.15.129:0/2745065863 conn(0x7f0194098e70 msgr2=0x7f01940a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- 172.21.15.129:0/2745065863 shutdown_connections 2020-01-26T15:26:11.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- 172.21.15.129:0/2745065863 wait complete. 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 Processor -- start 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.314+0000 7f0199399700 1 -- start start 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f019411e0d0 0x7f019411e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019407efb0 con 0x7f019411f120 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01940798e0 con 0x7f019411f550 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0194122540 con 0x7f019411e0d0 2020-01-26T15:26:11.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f019411e0d0 0x7f019411e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:11.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0193fff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f019411f120 0x7f0194121200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40684/0 (socket says 172.21.15.129:40684) 2020-01-26T15:26:11.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0193fff700 1 -- 172.21.15.129:0/2845566173 learned_addr learned my addr 172.21.15.129:0/2845566173 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:11.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> v2:172.21.15.129:6790/0 conn(0x7f019411e0d0 0x7f019411e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:11.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300298782 0 0) 0x7f019407efb0 con 0x7f019411f120 2020-01-26T15:26:11.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0178003230 con 0x7f019411f120 2020-01-26T15:26:11.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008099028 0 0) 0x7f01940798e0 con 0x7f019411f550 2020-01-26T15:26:11.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f019407efb0 con 0x7f019411f550 2020-01-26T15:26:11.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1658191244 0 0) 0x7f0178003230 con 0x7f019411f120 2020-01-26T15:26:11.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01940798e0 con 0x7f019411f120 2020-01-26T15:26:11.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f017c001830 con 0x7f019411f120 2020-01-26T15:26:11.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 >> v2:172.21.15.129:6790/0 conn(0x7f019411e0d0 msgr2=0x7f019411e740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 --2- 172.21.15.129:0/2845566173 >> v2:172.21.15.129:6790/0 conn(0x7f019411e0d0 0x7f019411e740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 >> v1:172.21.15.129:6790/0 conn(0x7f019411f550 legacy=0x7f0194121a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 >> v1:172.21.15.129:6789/0 conn(0x7f019411f120 legacy=0x7f0194121200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f019407efb0 con 0x7f017800a7f0 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0178003230 con 0x7f0178004060 2020-01-26T15:26:11.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194122540 con 0x7f0178003c30 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000777676 0 0) 0x7f0178003230 con 0x7f0178004060 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017800e440 con 0x7f0178004060 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282675876 0 0) 0x7f019407efb0 con 0x7f017800a7f0 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 -- 172.21.15.129:0/2845566173 >> v1:172.21.15.129:6791/0 conn(0x7f0178004060 legacy=0x7f0178004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 -- 172.21.15.129:0/2845566173 >> v1:172.21.15.129:6790/0 conn(0x7f017800a7f0 legacy=0x7f017800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.332 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178003810 con 0x7f0178003c30 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019411f550 con 0x7f0178003c30 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194121a00 con 0x7f0178003c30 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.333 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f018c0114b0 con 0x7f0178003c30 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.318+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c0116b0 con 0x7f0178003c30 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f018c011ad0 con 0x7f0178003c30 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c003360 con 0x7f0178003c30 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f018c011cd0 con 0x7f0178003c30 2020-01-26T15:26:11.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.322+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f018c04d4e0 con 0x7f0178003c30 2020-01-26T15:26:11.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.330+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.330+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f018c033630 con 0x7f0178003c30 2020-01-26T15:26:11.483 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.482+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f016c003790 con 0x7f0178003c30 2020-01-26T15:26:11.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.482+0000 7f0198b98700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:11.484 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.482+0000 7f01917fa700 1 -- 172.21.15.129:0/2845566173 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f018c033890 con 0x7f0178003c30 2020-01-26T15:26:11.484 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:11.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 >> v1:172.21.15.129:6800/16899 conn(0x7f0178048070 legacy=0x7f017804a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 msgr2=0x7f01780045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f019a5fb700 1 -- 172.21.15.129:0/2845566173 reap_dead start 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f018c0032b0 tx=0x7f018c010e60).stop 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 shutdown_connections 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 --2- 172.21.15.129:0/2845566173 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0178003c30 0x7f01780045a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 >> 172.21.15.129:0/2845566173 conn(0x7f01940a5520 msgr2=0x7f01940a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:11.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 shutdown_connections 2020-01-26T15:26:11.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:11.486+0000 7f0199399700 1 -- 172.21.15.129:0/2845566173 wait complete. 2020-01-26T15:26:11.497 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:14.498 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:14.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 Processor -- start 2020-01-26T15:26:14.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 -- start start 2020-01-26T15:26:14.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1cc4146c30 0x7f1cc4149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:14.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1cc41495c0 0x7f1cc414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:14.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc40a5b80 con 0x7f1cc40a5750 2020-01-26T15:26:14.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40a43f0 con 0x7f1cc4146c30 2020-01-26T15:26:14.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cca526700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40a5210 con 0x7f1cc41495c0 2020-01-26T15:26:14.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc92c4700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1cc41495c0 0x7f1cc414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:14.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc8ac3700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f1cc40a5750 0x7f1cc40a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40698/0 (socket says 172.21.15.129:40698) 2020-01-26T15:26:14.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc8ac3700 1 -- 172.21.15.129:0/2916464806 learned_addr learned my addr 172.21.15.129:0/2916464806 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:14.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41495c0 0x7f1cc414ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:14.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc3fff700 -1 --2- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6790/0 conn(0x7f1cc4146c30 0x7f1cc4149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:14.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc3fff700 1 --2- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6790/0 conn(0x7f1cc4146c30 0x7f1cc4149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:14.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138448823 0 0) 0x7f1cc40a5b80 con 0x7f1cc40a5750 2020-01-26T15:26:14.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb0003230 con 0x7f1cc40a5750 2020-01-26T15:26:14.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3091012658 0 0) 0x7f1cb0003230 con 0x7f1cc40a5750 2020-01-26T15:26:14.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41495c0 msgr2=0x7f1cc414ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:14.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 --2- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41495c0 0x7f1cc414ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:14.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6790/0 conn(0x7f1cc4146c30 msgr2=0x7f1cc4149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:14.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 --2- 172.21.15.129:0/2916464806 >> v2:172.21.15.129:6790/0 conn(0x7f1cc4146c30 0x7f1cc4149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:14.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4080440 con 0x7f1cc40a5750 2020-01-26T15:26:14.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1cb4001710 con 0x7f1cc40a5750 2020-01-26T15:26:14.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 >> v1:172.21.15.129:6789/0 conn(0x7f1cc40a5750 legacy=0x7f1cc40a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:14.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1cb0003230 con 0x7f1cb0007800 2020-01-26T15:26:14.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1cc40a5b80 con 0x7f1cb0003890 2020-01-26T15:26:14.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40a43f0 con 0x7f1cb000b5d0 2020-01-26T15:26:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.614+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249635305 0 0) 0x7f1cc40a5b80 con 0x7f1cb0003890 2020-01-26T15:26:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb000f330 con 0x7f1cb0003890 2020-01-26T15:26:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 -- 172.21.15.129:0/2916464806 >> v1:172.21.15.129:6791/0 conn(0x7f1cb0003890 legacy=0x7f1cb0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.627 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 -- 172.21.15.129:0/2916464806 >> v1:172.21.15.129:6790/0 conn(0x7f1cb0007800 legacy=0x7f1cb0009d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421914837 0 0) 0x7f1cb0003230 con 0x7f1cb0007800 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 -- 172.21.15.129:0/2916464806 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0054490 con 0x7f1cb000b5d0 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 -- 172.21.15.129:0/2916464806 reap_dead start 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:14.628 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).ready entity=mon.0 client_cookie=4b535aae6d80d5ce server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1cbc010a90 con 0x7f1cb000b5d0 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc010c90 con 0x7f1cb000b5d0 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:14.629 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cc37fe700 1 -- 172.21.15.129:0/2916464806 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1cbc0110c0 con 0x7f1cb000b5d0 2020-01-26T15:26:14.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 -- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 msgr2=0x7f1cb000dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f1cbc0032b0 tx=0x7f1cbc0101c0).stop 2020-01-26T15:26:14.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 -- 172.21.15.129:0/2916464806 shutdown_connections 2020-01-26T15:26:14.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 --2- 172.21.15.129:0/2916464806 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1cb000b5d0 0x7f1cb000dae0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:14.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 -- 172.21.15.129:0/2916464806 >> 172.21.15.129:0/2916464806 conn(0x7f1cc405e050 msgr2=0x7f1cc4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:14.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 -- 172.21.15.129:0/2916464806 shutdown_connections 2020-01-26T15:26:14.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 -- 172.21.15.129:0/2916464806 wait complete. 2020-01-26T15:26:14.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.618+0000 7f1cca526700 1 Processor -- start 2020-01-26T15:26:14.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- start start 2020-01-26T15:26:14.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 0x7f1cc41398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:14.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc407dba0 con 0x7f1cc40a28a0 2020-01-26T15:26:14.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc4095550 con 0x7f1cc407ba80 2020-01-26T15:26:14.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40a6ef0 con 0x7f1cc41374b0 2020-01-26T15:26:14.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc8ac3700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1cc40a28a0 0x7f1cc40a0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49012/0 (socket says 172.21.15.129:49012) 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc92c4700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 0x7f1cc41398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc8ac3700 1 -- 172.21.15.129:0/2354601002 learned_addr learned my addr 172.21.15.129:0/2354601002 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc92c4700 1 --2- 172.21.15.129:0/2354601002 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 0x7f1cc41398f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056423699 0 0) 0x7f1cc407dba0 con 0x7f1cc40a28a0 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca8003230 con 0x7f1cc40a28a0 2020-01-26T15:26:14.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470236425 0 0) 0x7f1cc4095550 con 0x7f1cc407ba80 2020-01-26T15:26:14.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc407dba0 con 0x7f1cc407ba80 2020-01-26T15:26:14.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3627186269 0 0) 0x7f1cc407dba0 con 0x7f1cc407ba80 2020-01-26T15:26:14.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1cc4095550 con 0x7f1cc407ba80 2020-01-26T15:26:14.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3599850696 0 0) 0x7f1ca8003230 con 0x7f1cc40a28a0 2020-01-26T15:26:14.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1cc407dba0 con 0x7f1cc40a28a0 2020-01-26T15:26:14.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1cac0016a0 con 0x7f1cc407ba80 2020-01-26T15:26:14.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1cb4001b20 con 0x7f1cc40a28a0 2020-01-26T15:26:14.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 992609348 0 0) 0x7f1cc4095550 con 0x7f1cc407ba80 2020-01-26T15:26:14.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 msgr2=0x7f1cc41398f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 --2- 172.21.15.129:0/2354601002 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 0x7f1cc41398f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 >> v1:172.21.15.129:6790/0 conn(0x7f1cc40a28a0 legacy=0x7f1cc40a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4122280 con 0x7f1cc407ba80 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40a17d0 con 0x7f1cc407ba80 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4095e90 con 0x7f1cc407ba80 2020-01-26T15:26:14.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1cac0018f0 con 0x7f1cc407ba80 2020-01-26T15:26:14.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.622+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1cac001d10 con 0x7f1cc407ba80 2020-01-26T15:26:14.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.626+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c003360 con 0x7f1cc407ba80 2020-01-26T15:26:14.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.626+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f1cac001f90 con 0x7f1cc407ba80 2020-01-26T15:26:14.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.626+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f1cac04b7e0 con 0x7f1cc407ba80 2020-01-26T15:26:14.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.630+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1cac0028c0 con 0x7f1cc407ba80 2020-01-26T15:26:14.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1c9c0037d0 con 0x7f1cc407ba80 2020-01-26T15:26:14.786 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cc17fa700 1 -- 172.21.15.129:0/2354601002 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1cac030d00 con 0x7f1cc407ba80 2020-01-26T15:26:14.787 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:14.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 >> v1:172.21.15.129:6800/16899 conn(0x7f1ca803e4b0 legacy=0x7f1ca80409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 >> v1:172.21.15.129:6791/0 conn(0x7f1cc407ba80 legacy=0x7f1cc407beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:14.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 shutdown_connections 2020-01-26T15:26:14.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 --2- 172.21.15.129:0/2354601002 >> v2:172.21.15.129:6791/0 conn(0x7f1cc41374b0 0x7f1cc41398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:14.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.786+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 >> 172.21.15.129:0/2354601002 conn(0x7f1cc405e050 msgr2=0x7f1cc4096190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:14.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.790+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 shutdown_connections 2020-01-26T15:26:14.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:14.790+0000 7f1cca526700 1 -- 172.21.15.129:0/2354601002 wait complete. 2020-01-26T15:26:14.805 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:17.806 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:17.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.926+0000 7f15fe310700 1 Processor -- start 2020-01-26T15:26:17.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.926+0000 7f15fe310700 1 -- start start 2020-01-26T15:26:17.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f805ea20 con 0x7f15f805edd0 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f8098000 con 0x7f15f805e5f0 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f805e050 con 0x7f15f80a6870 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fdb0f700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f15f805edd0 0x7f15f807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40718/0 (socket says 172.21.15.129:40718) 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fdb0f700 1 -- 172.21.15.129:0/2465338432 learned_addr learned my addr 172.21.15.129:0/2465338432 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269897351 0 0) 0x7f15f8098000 con 0x7f15f805e5f0 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e4003230 con 0x7f15f805e5f0 2020-01-26T15:26:17.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469400591 0 0) 0x7f15f805ea20 con 0x7f15f805edd0 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f8098000 con 0x7f15f805edd0 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554595948 0 0) 0x7f15f805e050 con 0x7f15f80a6870 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f805ea20 con 0x7f15f80a6870 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3413877508 0 0) 0x7f15e4003230 con 0x7f15f805e5f0 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 >> v1:172.21.15.129:6791/0 conn(0x7f15f80a6870 legacy=0x7f15f814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 >> v1:172.21.15.129:6789/0 conn(0x7f15f805edd0 legacy=0x7f15f807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80a6ca0 con 0x7f15f805e5f0 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15e8001710 con 0x7f15f805e5f0 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15e80019e0 con 0x7f15f805e5f0 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fcb0d700 1 -- 172.21.15.129:0/2465338432 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15e8001ec0 con 0x7f15f805e5f0 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- 172.21.15.129:0/2465338432 >> v1:172.21.15.129:6790/0 conn(0x7f15f805e5f0 legacy=0x7f15f8149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- 172.21.15.129:0/2465338432 shutdown_connections 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- 172.21.15.129:0/2465338432 >> 172.21.15.129:0/2465338432 conn(0x7f15f8098e70 msgr2=0x7f15f80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- 172.21.15.129:0/2465338432 shutdown_connections 2020-01-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.930+0000 7f15fe310700 1 -- 172.21.15.129:0/2465338432 wait complete. 2020-01-26T15:26:17.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 Processor -- start 2020-01-26T15:26:17.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 -- start start 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f15f811f560 0x7f15f80a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15f8120350 0x7f15f8120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f8121c00 con 0x7f15f807daa0 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f15f80a3fb0 con 0x7f15f8120350 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fe310700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f15f807e6d0 con 0x7f15f811f560 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fd30e700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15f8120350 0x7f15f8120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:17.942 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fd30e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15f8120350 0x7f15f8120780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f15f811f560 0x7f15f80a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f15f811f560 0x7f15f80a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ff572700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f15f807daa0 0x7f15f807ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40728/0 (socket says 172.21.15.129:40728) 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ff572700 1 -- 172.21.15.129:0/3693558859 learned_addr learned my addr 172.21.15.129:0/3693558859 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206261652 0 0) 0x7f15f8121c00 con 0x7f15f807daa0 2020-01-26T15:26:17.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003230 con 0x7f15f807daa0 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1759531041 0 0) 0x7f15e0003230 con 0x7f15f807daa0 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15f8121c00 con 0x7f15f807daa0 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15f0002d00 con 0x7f15f807daa0 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 >> v2:172.21.15.129:6791/0 conn(0x7f15f811f560 msgr2=0x7f15f80a1330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 --2- 172.21.15.129:0/3693558859 >> v2:172.21.15.129:6791/0 conn(0x7f15f811f560 0x7f15f80a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 >> v2:172.21.15.129:6790/0 conn(0x7f15f8120350 msgr2=0x7f15f8120780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 --2- 172.21.15.129:0/3693558859 >> v2:172.21.15.129:6790/0 conn(0x7f15f8120350 0x7f15f8120780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:17.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 >> v1:172.21.15.129:6789/0 conn(0x7f15f807daa0 legacy=0x7f15f807ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:17.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f15e0003230 con 0x7f15e00045a0 2020-01-26T15:26:17.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f15e0005320 con 0x7f15e000a7f0 2020-01-26T15:26:17.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80a3fb0 con 0x7f15e0003a20 2020-01-26T15:26:17.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123023941 0 0) 0x7f15e0003230 con 0x7f15e00045a0 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e000e440 con 0x7f15e00045a0 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259956678 0 0) 0x7f15e0005320 con 0x7f15e000a7f0 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003230 con 0x7f15e000a7f0 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 1 -- 172.21.15.129:0/3693558859 >> v1:172.21.15.129:6791/0 conn(0x7f15e000a7f0 legacy=0x7f15e000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 1 -- 172.21.15.129:0/3693558859 >> v1:172.21.15.129:6790/0 conn(0x7f15e00045a0 legacy=0x7f15e00049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:17.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.934+0000 7f15fdb0f700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8099a00 con 0x7f15e0003a20 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f80247b0 con 0x7f15e0003a20 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f8024ce0 con 0x7f15e0003a20 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ff572700 1 -- 172.21.15.129:0/3693558859 reap_dead start 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f15f4005d30 con 0x7f15e0003a20 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400a320 con 0x7f15e0003a20 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f15f400a700 con 0x7f15e0003a20 2020-01-26T15:26:17.948 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.949 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d4003360 con 0x7f15e0003a20 2020-01-26T15:26:17.949 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f15f400a950 con 0x7f15e0003a20 2020-01-26T15:26:17.949 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.949 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.938+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f15f404d260 con 0x7f15e0003a20 2020-01-26T15:26:17.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.942+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:17.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:17.942+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f15f40333f0 con 0x7f15e0003a20 2020-01-26T15:26:18.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f15d4003790 con 0x7f15e0003a20 2020-01-26T15:26:18.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fdb0f700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:18.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15ee7fc700 1 -- 172.21.15.129:0/3693558859 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f15f4033650 con 0x7f15e0003a20 2020-01-26T15:26:18.102 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:18.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 >> v1:172.21.15.129:6800/16899 conn(0x7f15e0044ed0 legacy=0x7f15e00473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:18.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 msgr2=0x7f15e0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:18.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7f15f4000b80 tx=0x7f15f4010970).stop 2020-01-26T15:26:18.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 shutdown_connections 2020-01-26T15:26:18.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 --2- 172.21.15.129:0/3693558859 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e0003a20 0x7f15e0003e90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:18.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 >> 172.21.15.129:0/3693558859 conn(0x7f15f80a4b40 msgr2=0x7f15f81242e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:18.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 shutdown_connections 2020-01-26T15:26:18.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:18.102+0000 7f15fe310700 1 -- 172.21.15.129:0/3693558859 wait complete. 2020-01-26T15:26:18.115 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:21.118 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 Processor -- start 2020-01-26T15:26:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 -- start start 2020-01-26T15:26:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 0x7f826c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:21.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 0x7f826c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c0a6dc0 con 0x7f826c05edd0 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f826c05ea20 con 0x7f826c05e5f0 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f826c098000 con 0x7f826c149040 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827245d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f826c05edd0 0x7f826c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49038/0 (socket says 172.21.15.129:49038) 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827245d700 1 -- 172.21.15.129:0/3516889287 learned_addr learned my addr 172.21.15.129:0/3516889287 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8271c5c700 -1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 0x7f826c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:21.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8271c5c700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 0x7f826c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8273ec0700 -1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 0x7f826c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8273ec0700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 0x7f826c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157663028 0 0) 0x7f826c0a6dc0 con 0x7f826c05edd0 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8254003230 con 0x7f826c05edd0 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1053736043 0 0) 0x7f8254003230 con 0x7f826c05edd0 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 msgr2=0x7f826c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:21.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 0x7f826c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 msgr2=0x7f826c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 0x7f826c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c05e050 con 0x7f826c05edd0 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f825c001a90 con 0x7f826c05edd0 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f825c001e20 con 0x7f826c05edd0 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f827145b700 1 -- 172.21.15.129:0/3516889287 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f825c004ae0 con 0x7f826c05edd0 2020-01-26T15:26:21.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.230+0000 7f8272c5e700 1 -- 172.21.15.129:0/3516889287 >> v1:172.21.15.129:6790/0 conn(0x7f826c05edd0 legacy=0x7f826c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 -- 172.21.15.129:0/3516889287 shutdown_connections 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6791/0 conn(0x7f826c149040 0x7f826c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 --2- 172.21.15.129:0/3516889287 >> v2:172.21.15.129:6790/0 conn(0x7f826c05e5f0 0x7f826c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 -- 172.21.15.129:0/3516889287 >> 172.21.15.129:0/3516889287 conn(0x7f826c098e70 msgr2=0x7f826c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 -- 172.21.15.129:0/3516889287 shutdown_connections 2020-01-26T15:26:21.240 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.234+0000 7f8272c5e700 1 -- 172.21.15.129:0/3516889287 wait complete. 2020-01-26T15:26:21.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 Processor -- start 2020-01-26T15:26:21.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- start start 2020-01-26T15:26:21.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 0x7f826c07c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:21.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c0a4e00 con 0x7f826c0a40e0 2020-01-26T15:26:21.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c121a70 con 0x7f826c07cb10 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f826c0a1fc0 con 0x7f826c09a200 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f827245d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f826c0a40e0 0x7f826c099a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49044/0 (socket says 172.21.15.129:49044) 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f827245d700 1 -- 172.21.15.129:0/1585295034 learned_addr learned my addr 172.21.15.129:0/1585295034 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8271c5c700 -1 --2- 172.21.15.129:0/1585295034 >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 0x7f826c07c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8271c5c700 1 --2- 172.21.15.129:0/1585295034 >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 0x7f826c07c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:21.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741203724 0 0) 0x7f826c0a4e00 con 0x7f826c0a40e0 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f824c003230 con 0x7f826c0a40e0 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638102117 0 0) 0x7f826c121a70 con 0x7f826c07cb10 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c0a4e00 con 0x7f826c07cb10 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2331842901 0 0) 0x7f826c0a4e00 con 0x7f826c07cb10 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f826c121a70 con 0x7f826c07cb10 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 560144538 0 0) 0x7f824c003230 con 0x7f826c0a40e0 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f826c0a4e00 con 0x7f826c0a40e0 2020-01-26T15:26:21.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8264002600 con 0x7f826c07cb10 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f825c0017a0 con 0x7f826c0a40e0 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3112752625 0 0) 0x7f826c121a70 con 0x7f826c07cb10 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 msgr2=0x7f826c07c5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 --2- 172.21.15.129:0/1585295034 >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 0x7f826c07c5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 >> v1:172.21.15.129:6790/0 conn(0x7f826c0a40e0 legacy=0x7f826c099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0a3c40 con 0x7f826c07cb10 2020-01-26T15:26:21.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c07cf40 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.238+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c138c60 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.242+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8264002d40 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.242+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8264001040 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.242+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c0a2510 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.242+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f82640012c0 con 0x7f826c07cb10 2020-01-26T15:26:21.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.242+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f826404b8f0 con 0x7f826c07cb10 2020-01-26T15:26:21.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.250+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f8264001c70 con 0x7f826c07cb10 2020-01-26T15:26:21.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.402+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f826c05c510 con 0x7f826c07cb10 2020-01-26T15:26:21.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.402+0000 7f826affd700 1 -- 172.21.15.129:0/1585295034 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f8264030db0 con 0x7f826c07cb10 2020-01-26T15:26:21.405 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 >> v1:172.21.15.129:6800/16899 conn(0x7f824c03e510 legacy=0x7f824c040a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:21.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 >> v1:172.21.15.129:6791/0 conn(0x7f826c07cb10 legacy=0x7f826c137450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 shutdown_connections 2020-01-26T15:26:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 --2- 172.21.15.129:0/1585295034 >> v2:172.21.15.129:6790/0 conn(0x7f826c09a200 0x7f826c07c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 >> 172.21.15.129:0/1585295034 conn(0x7f826c0a1150 msgr2=0x7f826c024bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 shutdown_connections 2020-01-26T15:26:21.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:21.406+0000 7f8272c5e700 1 -- 172.21.15.129:0/1585295034 wait complete. 2020-01-26T15:26:21.422 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:24.424 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 Processor -- start 2020-01-26T15:26:24.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 -- start start 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fe018146c30 0x7fe018149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fe0181495c0 0x7fe01814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0180a5b80 con 0x7fe0180a5750 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180a43f0 con 0x7fe0181495c0 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe0202b3700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180a5210 con 0x7fe018146c30 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01f051700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fe0181495c0 0x7fe01814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:24.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01e04f700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fe018146c30 0x7fe018149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01e850700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fe0180a5750 0x7fe0180a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40752/0 (socket says 172.21.15.129:40752) 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01e850700 1 -- 172.21.15.129:0/717010415 learned_addr learned my addr 172.21.15.129:0/717010415 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01e04f700 1 --2- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6791/0 conn(0x7fe018146c30 0x7fe018149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01f051700 1 --2- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6790/0 conn(0x7fe0181495c0 0x7fe01814ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260924967 0 0) 0x7fe0180a5b80 con 0x7fe0180a5750 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.542+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe004003230 con 0x7fe0180a5750 2020-01-26T15:26:24.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 505516297 0 0) 0x7fe004003230 con 0x7fe0180a5750 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6791/0 conn(0x7fe018146c30 msgr2=0x7fe018149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 --2- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6791/0 conn(0x7fe018146c30 0x7fe018149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6790/0 conn(0x7fe0181495c0 msgr2=0x7fe01814ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 --2- 172.21.15.129:0/717010415 >> v2:172.21.15.129:6790/0 conn(0x7fe0181495c0 0x7fe01814ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018080440 con 0x7fe0180a5750 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe014001710 con 0x7fe0180a5750 2020-01-26T15:26:24.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 >> v1:172.21.15.129:6789/0 conn(0x7fe0180a5750 legacy=0x7fe0180a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe004003230 con 0x7fe00400a7f0 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe0180a5b80 con 0x7fe0040045a0 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180a43f0 con 0x7fe004003890 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865289754 0 0) 0x7fe0180a5b80 con 0x7fe0040045a0 2020-01-26T15:26:24.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe00400f860 con 0x7fe0040045a0 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095570721 0 0) 0x7fe004003230 con 0x7fe00400a7f0 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 -- 172.21.15.129:0/717010415 >> v1:172.21.15.129:6791/0 conn(0x7fe0040045a0 legacy=0x7fe0040049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 -- 172.21.15.129:0/717010415 >> v1:172.21.15.129:6790/0 conn(0x7fe00400a7f0 legacy=0x7fe00400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 -- 172.21.15.129:0/717010415 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00400f4b0 con 0x7fe004003890 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01f051700 1 -- 172.21.15.129:0/717010415 reap_dead start 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe014001000 tx=0x7fe01400c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe014001000 tx=0x7fe01400c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fe014001000 tx=0x7fe01400c2c0).ready entity=mon.0 client_cookie=929dfd173a30913b server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe014001000 tx=0x7fe01400c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe014005790 con 0x7fe004003890 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe014001000 tx=0x7fe01400c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01e850700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7fe014001000 tx=0x7fe01400c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe014005990 con 0x7fe004003890 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe01d84e700 1 -- 172.21.15.129:0/717010415 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe014005d30 con 0x7fe004003890 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 -- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 msgr2=0x7fe004003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7fe014001000 tx=0x7fe01400c2c0).stop 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 -- 172.21.15.129:0/717010415 shutdown_connections 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 --2- 172.21.15.129:0/717010415 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe004003890 0x7fe004003d00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 -- 172.21.15.129:0/717010415 >> 172.21.15.129:0/717010415 conn(0x7fe01805e050 msgr2=0x7fe018098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:24.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 -- 172.21.15.129:0/717010415 shutdown_connections 2020-01-26T15:26:24.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.546+0000 7fe0202b3700 1 -- 172.21.15.129:0/717010415 wait complete. 2020-01-26T15:26:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 Processor -- start 2020-01-26T15:26:24.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- start start 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01807dc80 con 0x7fe01807d850 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe018096340 con 0x7fe018138160 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe018120530 con 0x7fe01811e410 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01e850700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fe01807d850 0x7fe01811dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40764/0 (socket says 172.21.15.129:40764) 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01e850700 1 -- 172.21.15.129:0/283594202 learned_addr learned my addr 172.21.15.129:0/283594202 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:24.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273872182 0 0) 0x7fe01807dc80 con 0x7fe01807d850 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003230 con 0x7fe01807d850 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504072912 0 0) 0x7fe018120530 con 0x7fe01811e410 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe01807dc80 con 0x7fe01811e410 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428717452 0 0) 0x7fe018096340 con 0x7fe018138160 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe018120530 con 0x7fe018138160 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 894445656 0 0) 0x7fe01807dc80 con 0x7fe01811e410 2020-01-26T15:26:24.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe018096340 con 0x7fe01811e410 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe00c0016f0 con 0x7fe01811e410 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4170315243 0 0) 0x7fe000003230 con 0x7fe01807d850 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe01807dc80 con 0x7fe01807d850 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fe0140018b0 con 0x7fe01807d850 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6791/0 conn(0x7fe01811e410 legacy=0x7fe018136950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6790/0 conn(0x7fe018138160 legacy=0x7fe01813a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6789/0 conn(0x7fe01807d850 legacy=0x7fe01811dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe000003230 con 0x7fe0000040f0 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fe00000f9a0 con 0x7fe000004da0 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000010be0 con 0x7fe00000c000 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252772224 0 0) 0x7fe000003230 con 0x7fe0000040f0 2020-01-26T15:26:24.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe00000fbd0 con 0x7fe0000040f0 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485717941 0 0) 0x7fe00000f9a0 con 0x7fe000004da0 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003230 con 0x7fe000004da0 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6791/0 conn(0x7fe000004da0 legacy=0x7fe00000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6790/0 conn(0x7fe0000040f0 legacy=0x7fe0000045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fe01811f4e0 con 0x7fe00000c000 2020-01-26T15:26:24.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01807ac70 con 0x7fe00000c000 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe018120980 con 0x7fe00000c000 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fe010005a50 con 0x7fe00000c000 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.550+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010005c50 con 0x7fe00000c000 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.554+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.554+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff4003360 con 0x7fe00000c000 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.554+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fe010007170 con 0x7fe00000c000 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.554+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.554+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fe01004c980 con 0x7fe00000c000 2020-01-26T15:26:24.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.558+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.558+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fe010032ad0 con 0x7fe00000c000 2020-01-26T15:26:24.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.714+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdff4003790 con 0x7fe00000c000 2020-01-26T15:26:24.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe01f051700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:24.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe00b7fe700 1 -- 172.21.15.129:0/283594202 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fe010032d30 con 0x7fe00000c000 2020-01-26T15:26:24.717 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:24.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 >> v1:172.21.15.129:6800/16899 conn(0x7fe00004cf70 legacy=0x7fe00004f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 msgr2=0x7fe00000e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 --2- 172.21.15.129:0/283594202 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fe00000c000 0x7fe00000e440 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fe014001420 tx=0x7fe0100108d0).stop 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe01f051700 1 -- 172.21.15.129:0/283594202 reap_dead start 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 shutdown_connections 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 >> 172.21.15.129:0/283594202 conn(0x7fe01807fb60 msgr2=0x7fe01807e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:24.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 shutdown_connections 2020-01-26T15:26:24.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:24.718+0000 7fe0202b3700 1 -- 172.21.15.129:0/283594202 wait complete. 2020-01-26T15:26:24.737 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:27.738 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:27.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 Processor -- start 2020-01-26T15:26:27.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 -- start start 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 0x7f51d40a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d40a5b80 con 0x7f51d40a4b50 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d4080440 con 0x7f51d405f250 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51daa58700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40a43f0 con 0x7f51d40a5750 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51d8ff5700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 0x7f51d40a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51d3fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f51d40a4b50 0x7f51d405ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49080/0 (socket says 172.21.15.129:49080) 2020-01-26T15:26:27.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51d3fff700 1 -- 172.21.15.129:0/1028941343 learned_addr learned my addr 172.21.15.129:0/1028941343 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51d97f6700 1 --1- 172.21.15.129:0/1028941343 >> v1:172.21.15.129:6791/0 conn(0x7f51d405f250 0x7f51d414bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46698/0 (socket says 172.21.15.129:46698) 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.850+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/1028941343 >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 0x7f51d40a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783986349 0 0) 0x7f51d40a5b80 con 0x7f51d40a4b50 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c0003230 con 0x7f51d40a4b50 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819263430 0 0) 0x7f51d4080440 con 0x7f51d405f250 2020-01-26T15:26:27.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d40a5b80 con 0x7f51d405f250 2020-01-26T15:26:27.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3148567705 0 0) 0x7f51c0003230 con 0x7f51d40a4b50 2020-01-26T15:26:27.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 msgr2=0x7f51d40a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:27.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 --2- 172.21.15.129:0/1028941343 >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 0x7f51d40a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:27.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 >> v1:172.21.15.129:6791/0 conn(0x7f51d405f250 legacy=0x7f51d414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40a3210 con 0x7f51d40a4b50 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f51bc001710 con 0x7f51d40a4b50 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f51bc001910 con 0x7f51d40a4b50 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51d37fe700 1 -- 172.21.15.129:0/1028941343 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f51bc0045b0 con 0x7f51d40a4b50 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 -- 172.21.15.129:0/1028941343 >> v1:172.21.15.129:6790/0 conn(0x7f51d40a4b50 legacy=0x7f51d405ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 -- 172.21.15.129:0/1028941343 shutdown_connections 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 --2- 172.21.15.129:0/1028941343 >> v2:172.21.15.129:6791/0 conn(0x7f51d40a5750 0x7f51d40a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:27.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 -- 172.21.15.129:0/1028941343 >> 172.21.15.129:0/1028941343 conn(0x7f51d405e050 msgr2=0x7f51d4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:27.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 -- 172.21.15.129:0/1028941343 shutdown_connections 2020-01-26T15:26:27.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 -- 172.21.15.129:0/1028941343 wait complete. 2020-01-26T15:26:27.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.854+0000 7f51daa58700 1 Processor -- start 2020-01-26T15:26:27.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- start start 2020-01-26T15:26:27.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d40606d0 con 0x7f51d4133cb0 2020-01-26T15:26:27.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d4064210 con 0x7f51d4061cb0 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d4060cf0 con 0x7f51d4061730 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f51d4061cb0 0x7f51d4063a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49086/0 (socket says 172.21.15.129:49086) 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 -- 172.21.15.129:0/3571749281 learned_addr learned my addr 172.21.15.129:0/3571749281 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108554107 0 0) 0x7f51d4064210 con 0x7f51d4061cb0 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b8003230 con 0x7f51d4061cb0 2020-01-26T15:26:27.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691378742 0 0) 0x7f51d40606d0 con 0x7f51d4133cb0 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4064210 con 0x7f51d4133cb0 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608620196 0 0) 0x7f51d4060cf0 con 0x7f51d4061730 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d40606d0 con 0x7f51d4061730 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3428449860 0 0) 0x7f51b8003230 con 0x7f51d4061cb0 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51d4060cf0 con 0x7f51d4061cb0 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f51cc002b00 con 0x7f51d4061cb0 2020-01-26T15:26:27.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2644799338 0 0) 0x7f51d40606d0 con 0x7f51d4061730 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51b8003230 con 0x7f51d4061730 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1379570444 0 0) 0x7f51d4064210 con 0x7f51d4133cb0 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51d40606d0 con 0x7f51d4133cb0 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f51bc001830 con 0x7f51d4061730 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f51c4001640 con 0x7f51d4133cb0 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6791/0 conn(0x7f51d4061730 legacy=0x7f51d41334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6790/0 conn(0x7f51d4061cb0 legacy=0x7f51d4063a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6789/0 conn(0x7f51d4133cb0 legacy=0x7f51d413bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f51d4060cf0 con 0x7f51b8003ec0 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f51d4064210 con 0x7f51b800aff0 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8010c60 con 0x7f51b8003540 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507594878 0 0) 0x7f51d4060cf0 con 0x7f51b8003ec0 2020-01-26T15:26:27.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b800ec40 con 0x7f51b8003ec0 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601743768 0 0) 0x7f51d4064210 con 0x7f51b800aff0 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d4060cf0 con 0x7f51b800aff0 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6791/0 conn(0x7f51b800aff0 legacy=0x7f51b800d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6790/0 conn(0x7f51b8003ec0 legacy=0x7f51b80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f51d407b1b0 con 0x7f51b8003540 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d4061cb0 con 0x7f51b8003540 2020-01-26T15:26:27.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d41340e0 con 0x7f51b8003540 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.858+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f51cc013650 con 0x7f51b8003540 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc013850 con 0x7f51b8003540 2020-01-26T15:26:27.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac003360 con 0x7f51b8003540 2020-01-26T15:26:27.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f51cc013a40 con 0x7f51b8003540 2020-01-26T15:26:27.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.862+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f51cc04e540 con 0x7f51b8003540 2020-01-26T15:26:27.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.866+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:27.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:27.866+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f51cc0346f0 con 0x7f51b8003540 2020-01-26T15:26:28.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f51ac003790 con 0x7f51b8003540 2020-01-26T15:26:28.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51d8ff5700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:28.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51d17fa700 1 -- 172.21.15.129:0/3571749281 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f51cc013d50 con 0x7f51b8003540 2020-01-26T15:26:28.022 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 >> v1:172.21.15.129:6800/16899 conn(0x7f51b8048bb0 legacy=0x7f51b804b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 msgr2=0x7f51b8003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 --2- 172.21.15.129:0/3571749281 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f51b8003540 0x7f51b8003970 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f51cc002910 tx=0x7f51cc011be0).stop 2020-01-26T15:26:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51d97f6700 1 -- 172.21.15.129:0/3571749281 reap_dead start 2020-01-26T15:26:28.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 shutdown_connections 2020-01-26T15:26:28.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 >> 172.21.15.129:0/3571749281 conn(0x7f51d4095e90 msgr2=0x7f51d405ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:28.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 shutdown_connections 2020-01-26T15:26:28.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:28.022+0000 7f51daa58700 1 -- 172.21.15.129:0/3571749281 wait complete. 2020-01-26T15:26:28.035 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:31.037 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 Processor -- start 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- start start 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 0x7fcb7805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78098000 con 0x7fcb78149040 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7805e050 con 0x7fcb780a6870 2020-01-26T15:26:31.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcb780a6ca0 con 0x7fcb7805edd0 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb777fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fcb780a6870 0x7fcb7807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46716/0 (socket says 172.21.15.129:46716) 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb777fe700 1 -- 172.21.15.129:0/1051457429 learned_addr learned my addr 172.21.15.129:0/1051457429 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb77fff700 -1 --2- 172.21.15.129:0/1051457429 >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 0x7fcb7805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb77fff700 1 --2- 172.21.15.129:0/1051457429 >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 0x7fcb7805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215561836 0 0) 0x7fcb7805e050 con 0x7fcb780a6870 2020-01-26T15:26:31.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb64003230 con 0x7fcb780a6870 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513819598 0 0) 0x7fcb78098000 con 0x7fcb78149040 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7805e050 con 0x7fcb78149040 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2897484282 0 0) 0x7fcb64003230 con 0x7fcb780a6870 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 msgr2=0x7fcb7805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 --2- 172.21.15.129:0/1051457429 >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 0x7fcb7805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 >> v1:172.21.15.129:6790/0 conn(0x7fcb78149040 legacy=0x7fcb7814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7814ecb0 con 0x7fcb780a6870 2020-01-26T15:26:31.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb60001a90 con 0x7fcb780a6870 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb60001d60 con 0x7fcb780a6870 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb76ffd700 1 -- 172.21.15.129:0/1051457429 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb60004930 con 0x7fcb780a6870 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/1051457429 >> v1:172.21.15.129:6791/0 conn(0x7fcb780a6870 legacy=0x7fcb7807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/1051457429 shutdown_connections 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 --2- 172.21.15.129:0/1051457429 >> v2:172.21.15.129:6790/0 conn(0x7fcb7805edd0 0x7fcb7805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/1051457429 >> 172.21.15.129:0/1051457429 conn(0x7fcb78098e70 msgr2=0x7fcb780a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:31.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/1051457429 shutdown_connections 2020-01-26T15:26:31.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.154+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/1051457429 wait complete. 2020-01-26T15:26:31.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 Processor -- start 2020-01-26T15:26:31.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 -- start start 2020-01-26T15:26:31.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 0x7fcb7811e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:31.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 0x7fcb7812cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:31.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7812c3f0 con 0x7fcb7812d020 2020-01-26T15:26:31.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcb780a1a50 con 0x7fcb7811f8b0 2020-01-26T15:26:31.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7ceb8700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7811e1c0 con 0x7fcb78120b20 2020-01-26T15:26:31.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb77fff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 0x7fcb7811e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:31.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb777fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 0x7fcb7812cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb77fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 0x7fcb7811e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb777fe700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 0x7fcb7812cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7e11a700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fcb7812d020 0x7fcb7812f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49108/0 (socket says 172.21.15.129:49108) 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb7e11a700 1 -- 172.21.15.129:0/2367058977 learned_addr learned my addr 172.21.15.129:0/2367058977 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637730621 0 0) 0x7fcb7812c3f0 con 0x7fcb7812d020 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.158+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c003230 con 0x7fcb7812d020 2020-01-26T15:26:31.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2494684981 0 0) 0x7fcb5c003230 con 0x7fcb7812d020 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb7812c3f0 con 0x7fcb7812d020 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb70001930 con 0x7fcb7812d020 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 550482709 0 0) 0x7fcb7812c3f0 con 0x7fcb7812d020 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 msgr2=0x7fcb7811e7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 --2- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 0x7fcb7811e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 msgr2=0x7fcb7812cad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:31.165 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 --2- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 0x7fcb7812cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:31.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7809e660 con 0x7fcb7812d020 2020-01-26T15:26:31.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7811fce0 con 0x7fcb7812d020 2020-01-26T15:26:31.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb781301b0 con 0x7fcb7812d020 2020-01-26T15:26:31.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb70002070 con 0x7fcb7812d020 2020-01-26T15:26:31.166 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb700024d0 con 0x7fcb7812d020 2020-01-26T15:26:31.167 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fcb700026d0 con 0x7fcb7812d020 2020-01-26T15:26:31.167 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7805c510 con 0x7fcb7812d020 2020-01-26T15:26:31.167 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.162+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fcb7004bac0 con 0x7fcb7812d020 2020-01-26T15:26:31.169 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.170+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fcb70031040 con 0x7fcb7812d020 2020-01-26T15:26:31.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.326+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcb78130820 con 0x7fcb7812d020 2020-01-26T15:26:31.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.326+0000 7fcb74ff9700 1 -- 172.21.15.129:0/2367058977 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fcb70002a90 con 0x7fcb7812d020 2020-01-26T15:26:31.328 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 >> v1:172.21.15.129:6800/16899 conn(0x7fcb5c03e0d0 legacy=0x7fcb5c0405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 >> v1:172.21.15.129:6790/0 conn(0x7fcb7812d020 legacy=0x7fcb7812f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 shutdown_connections 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 --2- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6791/0 conn(0x7fcb78120b20 0x7fcb7811e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 --2- 172.21.15.129:0/2367058977 >> v2:172.21.15.129:6790/0 conn(0x7fcb7811f8b0 0x7fcb7812cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:31.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 >> 172.21.15.129:0/2367058977 conn(0x7fcb7807f660 msgr2=0x7fcb781234f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:31.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 shutdown_connections 2020-01-26T15:26:31.331 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:31.330+0000 7fcb7ceb8700 1 -- 172.21.15.129:0/2367058977 wait complete. 2020-01-26T15:26:31.340 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:34.342 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:34.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 Processor -- start 2020-01-26T15:26:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 -- start start 2020-01-26T15:26:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f71c405e5f0 0x7f71c40a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40a6dc0 con 0x7f71c405edd0 2020-01-26T15:26:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c405ea20 con 0x7f71c4149040 2020-01-26T15:26:34.466 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f71c4098000 con 0x7f71c405e5f0 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c2d9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f71c405e5f0 0x7f71c40a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c2d9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f71c405e5f0 0x7f71c40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c359e700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f71c405edd0 0x7f71c407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40812/0 (socket says 172.21.15.129:40812) 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c912a700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f71c4149040 0x7f71c414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49114/0 (socket says 172.21.15.129:49114) 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c359e700 1 -- 172.21.15.129:0/1555202672 learned_addr learned my addr 172.21.15.129:0/1555202672 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477873275 0 0) 0x7f71c40a6dc0 con 0x7f71c405edd0 2020-01-26T15:26:34.467 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b0003230 con 0x7f71c405edd0 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693273293 0 0) 0x7f71c405ea20 con 0x7f71c4149040 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c40a6dc0 con 0x7f71c4149040 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4063076804 0 0) 0x7f71b0003230 con 0x7f71c405edd0 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 >> v2:172.21.15.129:6791/0 conn(0x7f71c405e5f0 msgr2=0x7f71c40a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 --2- 172.21.15.129:0/1555202672 >> v2:172.21.15.129:6791/0 conn(0x7f71c405e5f0 0x7f71c40a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 >> v1:172.21.15.129:6790/0 conn(0x7f71c4149040 legacy=0x7f71c414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.468 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c405e050 con 0x7f71c405edd0 2020-01-26T15:26:34.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f71ac001710 con 0x7f71c405edd0 2020-01-26T15:26:34.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 >> v1:172.21.15.129:6789/0 conn(0x7f71c405edd0 legacy=0x7f71c407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 --2- 172.21.15.129:0/1555202672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71b000b800 0x7f71b000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:34.469 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f71b0003230 con 0x7f71b0003f90 2020-01-26T15:26:34.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f71c405ea20 con 0x7f71b0003ac0 2020-01-26T15:26:34.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4098000 con 0x7f71b000b800 2020-01-26T15:26:34.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c912a700 1 --2- 172.21.15.129:0/1555202672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71b000b800 0x7f71b000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:34.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58140984 0 0) 0x7f71c405ea20 con 0x7f71b0003ac0 2020-01-26T15:26:34.470 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b000e2d0 con 0x7f71b0003ac0 2020-01-26T15:26:34.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722320403 0 0) 0x7f71b0003230 con 0x7f71b0003f90 2020-01-26T15:26:34.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c405ea20 con 0x7f71b0003f90 2020-01-26T15:26:34.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 684768049 0 0) 0x7f71b000e2d0 con 0x7f71b0003ac0 2020-01-26T15:26:34.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71b000b800 msgr2=0x7f71b000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:26:34.471 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 --2- 172.21.15.129:0/1555202672 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71b000b800 0x7f71b000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 >> v1:172.21.15.129:6790/0 conn(0x7f71b0003f90 legacy=0x7f71b0004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0054540 con 0x7f71b0003ac0 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f71ac004760 con 0x7f71b0003ac0 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f71ac004a30 con 0x7f71b0003ac0 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c259c700 1 -- 172.21.15.129:0/1555202672 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f71ac004e90 con 0x7f71b0003ac0 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c8929700 1 -- 172.21.15.129:0/1555202672 >> v1:172.21.15.129:6791/0 conn(0x7f71b0003ac0 legacy=0x7f71b00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.472 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.462+0000 7f71c912a700 1 -- 172.21.15.129:0/1555202672 reap_dead start 2020-01-26T15:26:34.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 -- 172.21.15.129:0/1555202672 shutdown_connections 2020-01-26T15:26:34.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 -- 172.21.15.129:0/1555202672 >> 172.21.15.129:0/1555202672 conn(0x7f71c4098e70 msgr2=0x7f71c40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:34.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 -- 172.21.15.129:0/1555202672 shutdown_connections 2020-01-26T15:26:34.473 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 -- 172.21.15.129:0/1555202672 wait complete. 2020-01-26T15:26:34.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 Processor -- start 2020-01-26T15:26:34.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.466+0000 7f71c8929700 1 -- start start 2020-01-26T15:26:34.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f71c409b1c0 0x7f71c409b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:34.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c409c380 con 0x7f71c409bce0 2020-01-26T15:26:34.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c409e190 con 0x7f71c409dd60 2020-01-26T15:26:34.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40a7ca0 con 0x7f71c409b1c0 2020-01-26T15:26:34.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c359e700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f71c409bce0 0x7f71c409caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40822/0 (socket says 172.21.15.129:40822) 2020-01-26T15:26:34.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c912a700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f71c409b1c0 0x7f71c409b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:34.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c359e700 1 -- 172.21.15.129:0/2439795037 learned_addr learned my addr 172.21.15.129:0/2439795037 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:34.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c912a700 1 --2- 172.21.15.129:0/2439795037 >> v2:172.21.15.129:6791/0 conn(0x7f71c409b1c0 0x7f71c409b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:34.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65085642 0 0) 0x7f71c409e190 con 0x7f71c409dd60 2020-01-26T15:26:34.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a8003230 con 0x7f71c409dd60 2020-01-26T15:26:34.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219366011 0 0) 0x7f71c409c380 con 0x7f71c409bce0 2020-01-26T15:26:34.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c409e190 con 0x7f71c409bce0 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3938853875 0 0) 0x7f71a8003230 con 0x7f71c409dd60 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71c409c380 con 0x7f71c409dd60 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f71bc002790 con 0x7f71c409dd60 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2758143127 0 0) 0x7f71c409e190 con 0x7f71c409bce0 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71a8003230 con 0x7f71c409bce0 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f71ac0015d0 con 0x7f71c409bce0 2020-01-26T15:26:34.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 >> v2:172.21.15.129:6791/0 conn(0x7f71c409b1c0 msgr2=0x7f71c409b5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 --2- 172.21.15.129:0/2439795037 >> v2:172.21.15.129:6791/0 conn(0x7f71c409b1c0 0x7f71c409b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 >> v1:172.21.15.129:6790/0 conn(0x7f71c409dd60 legacy=0x7f71c409a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 >> v1:172.21.15.129:6789/0 conn(0x7f71c409bce0 legacy=0x7f71c409caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f71c409e190 con 0x7f71a8003540 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f71a8004170 con 0x7f71a8004e90 2020-01-26T15:26:34.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40a7ca0 con 0x7f71a8009ff0 2020-01-26T15:26:34.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:34.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536508886 0 0) 0x7f71c409e190 con 0x7f71a8003540 2020-01-26T15:26:34.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a800e990 con 0x7f71a8003540 2020-01-26T15:26:34.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452999449 0 0) 0x7f71a8004170 con 0x7f71a8004e90 2020-01-26T15:26:34.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c409e190 con 0x7f71a8004e90 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 -- 172.21.15.129:0/2439795037 >> v1:172.21.15.129:6791/0 conn(0x7f71a8004e90 legacy=0x7f71a80087e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 -- 172.21.15.129:0/2439795037 >> v1:172.21.15.129:6790/0 conn(0x7f71a8003540 legacy=0x7f71a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f71a8004c20 con 0x7f71a8009ff0 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c407cf30 con 0x7f71a8009ff0 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c409df00 con 0x7f71a8009ff0 2020-01-26T15:26:34.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f71bc011b20 con 0x7f71a8009ff0 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.470+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc011d20 con 0x7f71a8009ff0 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.474+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.474+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c003360 con 0x7f71a8009ff0 2020-01-26T15:26:34.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.474+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f71bc0056d0 con 0x7f71a8009ff0 2020-01-26T15:26:34.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.474+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.474+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f71bc04d3a0 con 0x7f71a8009ff0 2020-01-26T15:26:34.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.482+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.482+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f71bc0334f0 con 0x7f71a8009ff0 2020-01-26T15:26:34.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f719c003790 con 0x7f71a8009ff0 2020-01-26T15:26:34.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c2d9d700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:34.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71bbfff700 1 -- 172.21.15.129:0/2439795037 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f71bc034de0 con 0x7f71a8009ff0 2020-01-26T15:26:34.639 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 >> v1:172.21.15.129:6800/16899 conn(0x7f71a80485e0 legacy=0x7f71a804aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 msgr2=0x7f71a800c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c912a700 1 -- 172.21.15.129:0/2439795037 reap_dead start 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f71bc0025a0 tx=0x7f71bc011510).stop 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 shutdown_connections 2020-01-26T15:26:34.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 --2- 172.21.15.129:0/2439795037 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f71a8009ff0 0x7f71a800c430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:34.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 >> 172.21.15.129:0/2439795037 conn(0x7f71c40a4f20 msgr2=0x7f71c40247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:34.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 shutdown_connections 2020-01-26T15:26:34.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:34.638+0000 7f71c8929700 1 -- 172.21.15.129:0/2439795037 wait complete. 2020-01-26T15:26:34.652 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:37.654 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:37.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 Processor -- start 2020-01-26T15:26:37.782 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 -- start start 2020-01-26T15:26:37.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 0x7f39d014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:37.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d005ea20 con 0x7f39d005edd0 2020-01-26T15:26:37.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d0098000 con 0x7f39d005e5f0 2020-01-26T15:26:37.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f39d005e050 con 0x7f39d00a6870 2020-01-26T15:26:37.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ceffd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f39d005e5f0 0x7f39d0149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46754/0 (socket says 172.21.15.129:46754) 2020-01-26T15:26:37.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39cf7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f39d005edd0 0x7f39d007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49136/0 (socket says 172.21.15.129:49136) 2020-01-26T15:26:37.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39d5a37700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 0x7f39d014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:37.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ceffd700 1 -- 172.21.15.129:0/401206596 learned_addr learned my addr 172.21.15.129:0/401206596 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:37.792 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39d5a37700 1 --2- 172.21.15.129:0/401206596 >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 0x7f39d014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:37.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843851975 0 0) 0x7f39d0098000 con 0x7f39d005e5f0 2020-01-26T15:26:37.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b0003230 con 0x7f39d005e5f0 2020-01-26T15:26:37.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969565552 0 0) 0x7f39d005ea20 con 0x7f39d005edd0 2020-01-26T15:26:37.793 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.770+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d0098000 con 0x7f39d005edd0 2020-01-26T15:26:37.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2499948501 0 0) 0x7f39b0003230 con 0x7f39d005e5f0 2020-01-26T15:26:37.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 msgr2=0x7f39d014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:37.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 --2- 172.21.15.129:0/401206596 >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 0x7f39d014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:37.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 >> v1:172.21.15.129:6790/0 conn(0x7f39d005edd0 legacy=0x7f39d007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:37.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00a6ca0 con 0x7f39d005e5f0 2020-01-26T15:26:37.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f39b8001710 con 0x7f39d005e5f0 2020-01-26T15:26:37.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f39b80019e0 con 0x7f39d005e5f0 2020-01-26T15:26:37.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39ce7fc700 1 -- 172.21.15.129:0/401206596 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f39b80045b0 con 0x7f39d005e5f0 2020-01-26T15:26:37.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- 172.21.15.129:0/401206596 >> v1:172.21.15.129:6791/0 conn(0x7f39d005e5f0 legacy=0x7f39d0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:37.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- 172.21.15.129:0/401206596 shutdown_connections 2020-01-26T15:26:37.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 --2- 172.21.15.129:0/401206596 >> v2:172.21.15.129:6791/0 conn(0x7f39d00a6870 0x7f39d014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:37.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- 172.21.15.129:0/401206596 >> 172.21.15.129:0/401206596 conn(0x7f39d0098e70 msgr2=0x7f39d00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:37.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- 172.21.15.129:0/401206596 shutdown_connections 2020-01-26T15:26:37.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- 172.21.15.129:0/401206596 wait complete. 2020-01-26T15:26:37.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 Processor -- start 2020-01-26T15:26:37.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.774+0000 7f39cffff700 1 -- start start 2020-01-26T15:26:37.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 0x7f39d011f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:37.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 0x7f39d013aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:37.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d009e320 con 0x7f39d007dfd0 2020-01-26T15:26:37.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f39d007e830 con 0x7f39d007e400 2020-01-26T15:26:37.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00a0450 con 0x7f39d009f1d0 2020-01-26T15:26:37.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cf7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 0x7f39d011f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:37.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cf7fe700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 0x7f39d011f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:37.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39ceffd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f39d007dfd0 0x7f39d0065920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49146/0 (socket says 172.21.15.129:49146) 2020-01-26T15:26:37.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39d5a37700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 0x7f39d013aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:37.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39ceffd700 1 -- 172.21.15.129:0/1463079135 learned_addr learned my addr 172.21.15.129:0/1463079135 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:37.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39d5a37700 1 --2- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 0x7f39d013aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:37.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516576996 0 0) 0x7f39b80019e0 con 0x7f39d007dfd0 2020-01-26T15:26:37.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a8003230 con 0x7f39d007dfd0 2020-01-26T15:26:37.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 977563751 0 0) 0x7f39a8003230 con 0x7f39d007dfd0 2020-01-26T15:26:37.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39b80019e0 con 0x7f39d007dfd0 2020-01-26T15:26:37.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f39b80046a0 con 0x7f39d007dfd0 2020-01-26T15:26:37.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1194414741 0 0) 0x7f39b80019e0 con 0x7f39d007dfd0 2020-01-26T15:26:37.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 msgr2=0x7f39d011f600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:37.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 --2- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 0x7f39d011f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:37.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 msgr2=0x7f39d013aaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:37.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 --2- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 0x7f39d013aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:37.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00a1db0 con 0x7f39d007dfd0 2020-01-26T15:26:37.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d009ee80 con 0x7f39d007dfd0 2020-01-26T15:26:37.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d0066120 con 0x7f39d007dfd0 2020-01-26T15:26:37.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f39b8004b50 con 0x7f39d007dfd0 2020-01-26T15:26:37.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f39b8004d80 con 0x7f39d007dfd0 2020-01-26T15:26:37.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.778+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac003360 con 0x7f39d007dfd0 2020-01-26T15:26:37.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.782+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f39b8010840 con 0x7f39d007dfd0 2020-01-26T15:26:37.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.782+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f39d009e320 con 0x7f39d007dfd0 2020-01-26T15:26:37.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.786+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f39b8031000 con 0x7f39d007dfd0 2020-01-26T15:26:37.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.938+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39ac0037d0 con 0x7f39d007dfd0 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39c7fff700 1 -- 172.21.15.129:0/1463079135 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f39b8031260 con 0x7f39d007dfd0 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 >> v1:172.21.15.129:6800/16899 conn(0x7f39a803e070 legacy=0x7f39a8040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 >> v1:172.21.15.129:6790/0 conn(0x7f39d007dfd0 legacy=0x7f39d0065920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 shutdown_connections 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 --2- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6790/0 conn(0x7f39d007e400 0x7f39d013aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:37.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 --2- 172.21.15.129:0/1463079135 >> v2:172.21.15.129:6791/0 conn(0x7f39d009f1d0 0x7f39d011f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:37.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 >> 172.21.15.129:0/1463079135 conn(0x7f39d00a1fc0 msgr2=0x7f39d007f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:37.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 shutdown_connections 2020-01-26T15:26:37.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:37.942+0000 7f39cffff700 1 -- 172.21.15.129:0/1463079135 wait complete. 2020-01-26T15:26:37.953 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:37.960 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:40.962 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:41.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 Processor -- start 2020-01-26T15:26:41.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 -- start start 2020-01-26T15:26:41.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3f540a6870 0x7f3f5414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:41.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5405ea20 con 0x7f3f5405edd0 2020-01-26T15:26:41.086 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f54098000 con 0x7f3f5405e5f0 2020-01-26T15:26:41.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5405e050 con 0x7f3f540a6870 2020-01-26T15:26:41.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f53fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f3f5405e5f0 0x7f3f54149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49154/0 (socket says 172.21.15.129:49154) 2020-01-26T15:26:41.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f53fff700 1 -- 172.21.15.129:0/866050629 learned_addr learned my addr 172.21.15.129:0/866050629 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:41.087 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f5a969700 -1 --2- 172.21.15.129:0/866050629 >> v2:172.21.15.129:6790/0 conn(0x7f3f540a6870 0x7f3f5414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:41.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --1- 172.21.15.129:0/866050629 >> v1:172.21.15.129:6789/0 conn(0x7f3f5405edd0 0x7f3f5407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40856/0 (socket says 172.21.15.129:40856) 2020-01-26T15:26:41.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f5a969700 1 --2- 172.21.15.129:0/866050629 >> v2:172.21.15.129:6790/0 conn(0x7f3f540a6870 0x7f3f5414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:41.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766126727 0 0) 0x7f3f5405ea20 con 0x7f3f5405edd0 2020-01-26T15:26:41.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f40003230 con 0x7f3f5405edd0 2020-01-26T15:26:41.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031729943 0 0) 0x7f3f54098000 con 0x7f3f5405e5f0 2020-01-26T15:26:41.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5405ea20 con 0x7f3f5405e5f0 2020-01-26T15:26:41.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 395816886 0 0) 0x7f3f40003230 con 0x7f3f5405edd0 2020-01-26T15:26:41.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 >> v2:172.21.15.129:6790/0 conn(0x7f3f540a6870 msgr2=0x7f3f5414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:41.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 --2- 172.21.15.129:0/866050629 >> v2:172.21.15.129:6790/0 conn(0x7f3f540a6870 0x7f3f5414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:41.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 >> v1:172.21.15.129:6790/0 conn(0x7f3f5405e5f0 legacy=0x7f3f54149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540a6ca0 con 0x7f3f5405edd0 2020-01-26T15:26:41.090 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3f44001710 con 0x7f3f5405edd0 2020-01-26T15:26:41.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 >> v1:172.21.15.129:6789/0 conn(0x7f3f5405edd0 legacy=0x7f3f5407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:41.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3f40003230 con 0x7f3f4000a7f0 2020-01-26T15:26:41.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3f54098000 con 0x7f3f400045a0 2020-01-26T15:26:41.091 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5405e050 con 0x7f3f40003ac0 2020-01-26T15:26:41.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:41.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 -- 172.21.15.129:0/866050629 >> v1:172.21.15.129:6791/0 conn(0x7f3f400045a0 legacy=0x7f3f400049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396677032 0 0) 0x7f3f54098000 con 0x7f3f400045a0 2020-01-26T15:26:41.092 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 -- 172.21.15.129:0/866050629 >> v1:172.21.15.129:6790/0 conn(0x7f3f4000a7f0 legacy=0x7f3f4000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 -- 172.21.15.129:0/866050629 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400545b0 con 0x7f3f40003ac0 2020-01-26T15:26:41.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3f44001520 tx=0x7f3f4400c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3f44001520 tx=0x7f3f4400c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f3f44001520 tx=0x7f3f4400c150).ready entity=mon.0 client_cookie=ca4267d77258aac0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:41.093 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f3f44001520 tx=0x7f3f4400c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3f44010160 con 0x7f3f40003ac0 2020-01-26T15:26:41.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f3f44001520 tx=0x7f3f4400c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f58f06700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f3f44001520 tx=0x7f3f4400c150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.094 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44010360 con 0x7f3f40003ac0 2020-01-26T15:26:41.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f537fe700 1 -- 172.21.15.129:0/866050629 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3f44010700 con 0x7f3f40003ac0 2020-01-26T15:26:41.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.082+0000 7f3f59707700 1 -- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 msgr2=0x7f3f40003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 --2- 172.21.15.129:0/866050629 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f40003ac0 0x7f3f40003f10 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f3f44001520 tx=0x7f3f4400c150).stop 2020-01-26T15:26:41.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f5a969700 1 -- 172.21.15.129:0/866050629 reap_dead start 2020-01-26T15:26:41.095 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 -- 172.21.15.129:0/866050629 shutdown_connections 2020-01-26T15:26:41.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 -- 172.21.15.129:0/866050629 >> 172.21.15.129:0/866050629 conn(0x7f3f54098e70 msgr2=0x7f3f540a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:41.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 -- 172.21.15.129:0/866050629 shutdown_connections 2020-01-26T15:26:41.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 -- 172.21.15.129:0/866050629 wait complete. 2020-01-26T15:26:41.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 Processor -- start 2020-01-26T15:26:41.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.086+0000 7f3f59707700 1 -- start start 2020-01-26T15:26:41.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3f54061d00 0x7f3f5407d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3f5407d5a0 0x7f3f541382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540a5010 con 0x7f3f540a4690 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540a4b30 con 0x7f3f54061d00 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5407f470 con 0x7f3f5407d5a0 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f58f06700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f3f540a4690 0x7f3f54060430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40866/0 (socket says 172.21.15.129:40866) 2020-01-26T15:26:41.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3f5407d5a0 0x7f3f541382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:41.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f58f06700 1 -- 172.21.15.129:0/3832677595 learned_addr learned my addr 172.21.15.129:0/3832677595 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:41.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6791/0 conn(0x7f3f5407d5a0 0x7f3f541382e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:41.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f53fff700 -1 --2- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6790/0 conn(0x7f3f54061d00 0x7f3f5407d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:41.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f53fff700 1 --2- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6790/0 conn(0x7f3f54061d00 0x7f3f5407d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:41.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927859110 0 0) 0x7f3f540a5010 con 0x7f3f540a4690 2020-01-26T15:26:41.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f38003230 con 0x7f3f540a4690 2020-01-26T15:26:41.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1515023594 0 0) 0x7f3f38003230 con 0x7f3f540a4690 2020-01-26T15:26:41.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f540a5010 con 0x7f3f540a4690 2020-01-26T15:26:41.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3f4400edf0 con 0x7f3f540a4690 2020-01-26T15:26:41.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6791/0 conn(0x7f3f5407d5a0 msgr2=0x7f3f541382e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:41.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 --2- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6791/0 conn(0x7f3f5407d5a0 0x7f3f541382e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:41.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6790/0 conn(0x7f3f54061d00 msgr2=0x7f3f5407d050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:41.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 --2- 172.21.15.129:0/3832677595 >> v2:172.21.15.129:6790/0 conn(0x7f3f54061d00 0x7f3f5407d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:41.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 >> v1:172.21.15.129:6789/0 conn(0x7f3f540a4690 legacy=0x7f3f54060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:41.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3f38003230 con 0x7f3f38003f20 2020-01-26T15:26:41.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3f3800f320 con 0x7f3f38003aa0 2020-01-26T15:26:41.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540a4b30 con 0x7f3f3800b800 2020-01-26T15:26:41.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:41.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433430375 0 0) 0x7f3f3800f320 con 0x7f3f38003aa0 2020-01-26T15:26:41.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3800f550 con 0x7f3f38003aa0 2020-01-26T15:26:41.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079840090 0 0) 0x7f3f38003230 con 0x7f3f38003f20 2020-01-26T15:26:41.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3800f320 con 0x7f3f38003f20 2020-01-26T15:26:41.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 -- 172.21.15.129:0/3832677595 >> v1:172.21.15.129:6791/0 conn(0x7f3f38003aa0 legacy=0x7f3f380045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 -- 172.21.15.129:0/3832677595 >> v1:172.21.15.129:6790/0 conn(0x7f3f38003f20 legacy=0x7f3f38004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5407d9d0 con 0x7f3f3800b800 2020-01-26T15:26:41.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f54062130 con 0x7f3f3800b800 2020-01-26T15:26:41.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 -- 172.21.15.129:0/3832677595 reap_dead start 2020-01-26T15:26:41.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:41.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5409e6c0 con 0x7f3f3800b800 2020-01-26T15:26:41.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3f4c00a4d0 con 0x7f3f3800b800 2020-01-26T15:26:41.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00a6d0 con 0x7f3f3800b800 2020-01-26T15:26:41.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3f4c00aa70 con 0x7f3f3800b800 2020-01-26T15:26:41.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.090+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f3f4c00ac70 con 0x7f3f3800b800 2020-01-26T15:26:41.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.094+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c003360 con 0x7f3f3800b800 2020-01-26T15:26:41.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.094+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f3f4c04d240 con 0x7f3f3800b800 2020-01-26T15:26:41.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.098+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.115 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.098+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f3f4c033350 con 0x7f3f3800b800 2020-01-26T15:26:41.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.254+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f2c003790 con 0x7f3f3800b800 2020-01-26T15:26:41.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.254+0000 7f3f5a969700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:41.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.254+0000 7f3f517fa700 1 -- 172.21.15.129:0/3832677595 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3f4c0335b0 con 0x7f3f3800b800 2020-01-26T15:26:41.256 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:41.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 >> v1:172.21.15.129:6800/16899 conn(0x7f3f38040cb0 legacy=0x7f3f380431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 msgr2=0x7f3f3800dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:41.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f3f54097910 tx=0x7f3f4c010a20).stop 2020-01-26T15:26:41.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 shutdown_connections 2020-01-26T15:26:41.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 --2- 172.21.15.129:0/3832677595 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3f3800b800 0x7f3f3800dca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:41.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 >> 172.21.15.129:0/3832677595 conn(0x7f3f54098e10 msgr2=0x7f3f5405edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:41.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 shutdown_connections 2020-01-26T15:26:41.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:41.258+0000 7f3f59707700 1 -- 172.21.15.129:0/3832677595 wait complete. 2020-01-26T15:26:41.269 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:44.270 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:44.390 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 Processor -- start 2020-01-26T15:26:44.390 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 -- start start 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0a6dc0 con 0x7f07dc05edd0 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc05ea20 con 0x7f07dc149040 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e2927700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc098000 con 0x7f07dc05e5f0 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e3b89700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f07dc149040 0x7f07dc14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46800/0 (socket says 172.21.15.129:46800) 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e3b89700 1 -- 172.21.15.129:0/3377199300 learned_addr learned my addr 172.21.15.129:0/3377199300 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:44.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e1925700 -1 --2- 172.21.15.129:0/3377199300 >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e1925700 1 --2- 172.21.15.129:0/3377199300 >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960548865 0 0) 0x7f07dc05ea20 con 0x7f07dc149040 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c8003230 con 0x7f07dc149040 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.386+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809030316 0 0) 0x7f07dc0a6dc0 con 0x7f07dc05edd0 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc05ea20 con 0x7f07dc05edd0 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2969128879 0 0) 0x7f07c8003230 con 0x7f07dc149040 2020-01-26T15:26:44.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 msgr2=0x7f07dc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 --2- 172.21.15.129:0/3377199300 >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 >> v1:172.21.15.129:6789/0 conn(0x7f07dc05edd0 legacy=0x7f07dc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc05e050 con 0x7f07dc149040 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f07d4001a90 con 0x7f07dc149040 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f07d4001ce0 con 0x7f07dc149040 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e1124700 1 -- 172.21.15.129:0/3377199300 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f07d4004930 con 0x7f07dc149040 2020-01-26T15:26:44.393 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- 172.21.15.129:0/3377199300 >> v1:172.21.15.129:6791/0 conn(0x7f07dc149040 legacy=0x7f07dc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:44.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- 172.21.15.129:0/3377199300 shutdown_connections 2020-01-26T15:26:44.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 --2- 172.21.15.129:0/3377199300 >> v2:172.21.15.129:6790/0 conn(0x7f07dc05e5f0 0x7f07dc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:44.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- 172.21.15.129:0/3377199300 >> 172.21.15.129:0/3377199300 conn(0x7f07dc098e70 msgr2=0x7f07dc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:44.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- 172.21.15.129:0/3377199300 shutdown_connections 2020-01-26T15:26:44.394 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- 172.21.15.129:0/3377199300 wait complete. 2020-01-26T15:26:44.397 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 Processor -- start 2020-01-26T15:26:44.397 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.390+0000 7f07e2927700 1 -- start start 2020-01-26T15:26:44.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 0x7f07dc120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:44.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc120970 con 0x7f07dc024fb0 2020-01-26T15:26:44.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc11ef60 con 0x7f07dc11f360 2020-01-26T15:26:44.398 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc07a200 con 0x7f07dc079dd0 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2126700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f07dc11f360 0x7f07dc0247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49186/0 (socket says 172.21.15.129:49186) 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2126700 1 -- 172.21.15.129:0/3992732264 learned_addr learned my addr 172.21.15.129:0/3992732264 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e1925700 -1 --2- 172.21.15.129:0/3992732264 >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 0x7f07dc120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e1925700 1 --2- 172.21.15.129:0/3992732264 >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 0x7f07dc120420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263090344 0 0) 0x7f07dc11ef60 con 0x7f07dc11f360 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c4003230 con 0x7f07dc11f360 2020-01-26T15:26:44.399 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679620988 0 0) 0x7f07dc120970 con 0x7f07dc024fb0 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc11ef60 con 0x7f07dc024fb0 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3930453922 0 0) 0x7f07c4003230 con 0x7f07dc11f360 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07dc120970 con 0x7f07dc11f360 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f07d80018d0 con 0x7f07dc11f360 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3052176443 0 0) 0x7f07dc120970 con 0x7f07dc11f360 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 msgr2=0x7f07dc120420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:44.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 --2- 172.21.15.129:0/3992732264 >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 0x7f07dc120420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 >> v1:172.21.15.129:6789/0 conn(0x7f07dc024fb0 legacy=0x7f07dc12a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc09e200 con 0x7f07dc11f360 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc0253e0 con 0x7f07dc11f360 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc12bea0 con 0x7f07dc11f360 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f07d80047c0 con 0x7f07dc11f360 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f07d80049b0 con 0x7f07dc11f360 2020-01-26T15:26:44.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.394+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b8003360 con 0x7f07dc11f360 2020-01-26T15:26:44.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.398+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f07d80103f0 con 0x7f07dc11f360 2020-01-26T15:26:44.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.398+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f07d804ba20 con 0x7f07dc11f360 2020-01-26T15:26:44.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.406+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f07d8030f40 con 0x7f07dc11f360 2020-01-26T15:26:44.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.558+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07b80037d0 con 0x7f07dc11f360 2020-01-26T15:26:44.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.558+0000 7f07d2ffd700 1 -- 172.21.15.129:0/3992732264 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f07d804a690 con 0x7f07dc11f360 2020-01-26T15:26:44.558 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:44.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 >> v1:172.21.15.129:6800/16899 conn(0x7f07c403e0f0 legacy=0x7f07c4040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:44.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 >> v1:172.21.15.129:6790/0 conn(0x7f07dc11f360 legacy=0x7f07dc0247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:44.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 shutdown_connections 2020-01-26T15:26:44.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 --2- 172.21.15.129:0/3992732264 >> v2:172.21.15.129:6790/0 conn(0x7f07dc079dd0 0x7f07dc120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:44.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 >> 172.21.15.129:0/3992732264 conn(0x7f07dc05c110 msgr2=0x7f07dc0a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:44.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 shutdown_connections 2020-01-26T15:26:44.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:44.562+0000 7f07e2927700 1 -- 172.21.15.129:0/3992732264 wait complete. 2020-01-26T15:26:44.577 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:47.578 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 Processor -- start 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- start start 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 0x7fbcbc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0a6dc0 con 0x7fbcbc149040 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc05ea20 con 0x7fbcbc05edd0 2020-01-26T15:26:47.700 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc098000 con 0x7fbcbc05e5f0 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbb7fe700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 0x7fbcbc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc2080700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbcbc149040 0x7fbcbc14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49198/0 (socket says 172.21.15.129:49198) 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc2080700 1 -- 172.21.15.129:0/371910986 learned_addr learned my addr 172.21.15.129:0/371910986 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbb7fe700 1 --2- 172.21.15.129:0/371910986 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 0x7fbcbc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbbfff700 1 --1- 172.21.15.129:0/371910986 >> v1:172.21.15.129:6791/0 conn(0x7fbcbc05edd0 0x7fbcbc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46812/0 (socket says 172.21.15.129:46812) 2020-01-26T15:26:47.701 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407143588 0 0) 0x7fbcbc05ea20 con 0x7fbcbc05edd0 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003230 con 0x7fbcbc05edd0 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531296420 0 0) 0x7fbcbc0a6dc0 con 0x7fbcbc149040 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcbc05ea20 con 0x7fbcbc149040 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 712688641 0 0) 0x7fbca4003230 con 0x7fbcbc05edd0 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 msgr2=0x7fbcbc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 --2- 172.21.15.129:0/371910986 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 0x7fbcbc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:47.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 >> v1:172.21.15.129:6790/0 conn(0x7fbcbc149040 legacy=0x7fbcbc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc05e050 con 0x7fbcbc05edd0 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbcac001710 con 0x7fbcbc05edd0 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbcac0019e0 con 0x7fbcbc05edd0 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcbaffd700 1 -- 172.21.15.129:0/371910986 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbcac0044f0 con 0x7fbcbc05edd0 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/371910986 >> v1:172.21.15.129:6791/0 conn(0x7fbcbc05edd0 legacy=0x7fbcbc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/371910986 shutdown_connections 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 --2- 172.21.15.129:0/371910986 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc05e5f0 0x7fbcbc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:47.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/371910986 >> 172.21.15.129:0/371910986 conn(0x7fbcbc098e70 msgr2=0x7fbcbc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:47.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/371910986 shutdown_connections 2020-01-26T15:26:47.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.698+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/371910986 wait complete. 2020-01-26T15:26:47.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 Processor -- start 2020-01-26T15:26:47.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- start start 2020-01-26T15:26:47.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 0x7fbcbc09e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 0x7fbcbc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc07b570 con 0x7fbcbc131190 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc0a0a50 con 0x7fbcbc0a1820 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc07b7a0 con 0x7fbcbc122740 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcbbfff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 0x7fbcbc09e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcbbfff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 0x7fbcbc09e0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:47.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc2080700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbcbc131190 0x7fbcbc07ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46820/0 (socket says 172.21.15.129:46820) 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc2080700 1 -- 172.21.15.129:0/1814806825 learned_addr learned my addr 172.21.15.129:0/1814806825 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcbb7fe700 -1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 0x7fbcbc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcbb7fe700 1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 0x7fbcbc0a1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268155305 0 0) 0x7fbcbc07b570 con 0x7fbcbc131190 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc9c003230 con 0x7fbcbc131190 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2110438920 0 0) 0x7fbc9c003230 con 0x7fbcbc131190 2020-01-26T15:26:47.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbcbc07b570 con 0x7fbcbc131190 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbcb4001740 con 0x7fbcbc131190 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3842568364 0 0) 0x7fbcbc07b570 con 0x7fbcbc131190 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 msgr2=0x7fbcbc09e0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 0x7fbcbc09e0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 msgr2=0x7fbcbc0a1180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 0x7fbcbc0a1180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:47.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc1315c0 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc131890 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc138780 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbcb4004b20 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.702+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbcb4004d10 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.706+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fbcb40107d0 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.706+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc05c510 con 0x7fbcbc131190 2020-01-26T15:26:47.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.706+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fbcb404be40 con 0x7fbcbc131190 2020-01-26T15:26:47.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.710+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fbcb4031300 con 0x7fbcbc131190 2020-01-26T15:26:47.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.866+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbcbc056600 con 0x7fbcbc131190 2020-01-26T15:26:47.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcb8ff9700 1 -- 172.21.15.129:0/1814806825 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fbcb404aa50 con 0x7fbcbc131190 2020-01-26T15:26:47.869 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:47.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 >> v1:172.21.15.129:6800/16899 conn(0x7fbc9c03e0f0 legacy=0x7fbc9c040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:47.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 >> v1:172.21.15.129:6791/0 conn(0x7fbcbc131190 legacy=0x7fbcbc07ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:47.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 shutdown_connections 2020-01-26T15:26:47.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6791/0 conn(0x7fbcbc122740 0x7fbcbc09e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:47.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 --2- 172.21.15.129:0/1814806825 >> v2:172.21.15.129:6790/0 conn(0x7fbcbc0a1820 0x7fbcbc0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:47.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 >> 172.21.15.129:0/1814806825 conn(0x7fbcbc05f0b0 msgr2=0x7fbcbc07e720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:47.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 shutdown_connections 2020-01-26T15:26:47.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:47.870+0000 7fbcc0e1e700 1 -- 172.21.15.129:0/1814806825 wait complete. 2020-01-26T15:26:47.881 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:50.883 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:51.009 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 Processor -- start 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 -- start start 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f468805edd0 0x7f468805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4688098000 con 0x7f46880a6870 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468805e050 con 0x7f4688149040 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468759e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f46880a6ca0 con 0x7f468805edd0 2020-01-26T15:26:51.010 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f4686d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f468805edd0 0x7f468805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f4686d9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f468805edd0 0x7f468805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.002+0000 7f468c97d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f4688149040 0x7f468814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46826/0 (socket says 172.21.15.129:46826) 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468c97d700 1 -- 172.21.15.129:0/3818177508 learned_addr learned my addr 172.21.15.129:0/3818177508 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468659c700 1 --1- 172.21.15.129:0/3818177508 >> v1:172.21.15.129:6789/0 conn(0x7f46880a6870 0x7f468807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40912/0 (socket says 172.21.15.129:40912) 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527332193 0 0) 0x7f4688098000 con 0x7f46880a6870 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4670003230 con 0x7f46880a6870 2020-01-26T15:26:51.011 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355180242 0 0) 0x7f468805e050 con 0x7f4688149040 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4688098000 con 0x7f4688149040 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3234359165 0 0) 0x7f4670003230 con 0x7f46880a6870 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 >> v2:172.21.15.129:6790/0 conn(0x7f468805edd0 msgr2=0x7f468805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 --2- 172.21.15.129:0/3818177508 >> v2:172.21.15.129:6790/0 conn(0x7f468805edd0 0x7f468805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 >> v1:172.21.15.129:6791/0 conn(0x7f4688149040 legacy=0x7f468814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468814ecb0 con 0x7f46880a6870 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f467c001710 con 0x7f46880a6870 2020-01-26T15:26:51.012 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 >> v1:172.21.15.129:6789/0 conn(0x7f46880a6870 legacy=0x7f468807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4670003230 con 0x7f467000a7f0 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f468805e050 con 0x7f4670003540 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a6ca0 con 0x7f4670004b20 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131627616 0 0) 0x7f468805e050 con 0x7f4670003540 2020-01-26T15:26:51.013 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467000e440 con 0x7f4670003540 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 -- 172.21.15.129:0/3818177508 >> v1:172.21.15.129:6791/0 conn(0x7f4670003540 legacy=0x7f4670003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 -- 172.21.15.129:0/3818177508 >> v1:172.21.15.129:6790/0 conn(0x7f467000a7f0 legacy=0x7f467000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 -- 172.21.15.129:0/3818177508 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670054530 con 0x7f4670004b20 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4678008900 tx=0x7f467800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4678008900 tx=0x7f467800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f4678008900 tx=0x7f467800fe60).ready entity=mon.0 client_cookie=b7a661d03a28c157 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:51.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f4678008900 tx=0x7f467800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:51.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4678008ca0 con 0x7f4670004b20 2020-01-26T15:26:51.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f4678008900 tx=0x7f467800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:51.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4678005780 con 0x7f4670004b20 2020-01-26T15:26:51.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4686d9d700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f4678008900 tx=0x7f467800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:51.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f4685d9b700 1 -- 172.21.15.129:0/3818177508 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4678005b20 con 0x7f4670004b20 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 -- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 msgr2=0x7f4670004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 --2- 172.21.15.129:0/3818177508 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f4670004b20 0x7f4670004f70 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f4678008900 tx=0x7f467800fe60).stop 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468c97d700 1 -- 172.21.15.129:0/3818177508 reap_dead start 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 -- 172.21.15.129:0/3818177508 shutdown_connections 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 -- 172.21.15.129:0/3818177508 >> 172.21.15.129:0/3818177508 conn(0x7f4688098e70 msgr2=0x7f46880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 -- 172.21.15.129:0/3818177508 shutdown_connections 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.006+0000 7f468759e700 1 -- 172.21.15.129:0/3818177508 wait complete. 2020-01-26T15:26:51.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 Processor -- start 2020-01-26T15:26:51.017 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 -- start start 2020-01-26T15:26:51.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 0x7f4688139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:51.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4688121550 con 0x7f4688079370 2020-01-26T15:26:51.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468811fe90 con 0x7f468811e460 2020-01-26T15:26:51.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468759e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4688123320 con 0x7f4688137a40 2020-01-26T15:26:51.019 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468c97d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 0x7f4688139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f4686d9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f468811e460 0x7f4688120d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49220/0 (socket says 172.21.15.129:49220) 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f4686d9d700 1 -- 172.21.15.129:0/2378870224 learned_addr learned my addr 172.21.15.129:0/2378870224 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f468c97d700 1 --2- 172.21.15.129:0/2378870224 >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 0x7f4688139e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584678554 0 0) 0x7f468811fe90 con 0x7f468811e460 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c003230 con 0x7f468811e460 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105064658 0 0) 0x7f4688121550 con 0x7f4688079370 2020-01-26T15:26:51.020 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468811fe90 con 0x7f4688079370 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2699555258 0 0) 0x7f466c003230 con 0x7f468811e460 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4688121550 con 0x7f468811e460 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.010+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4678005dc0 con 0x7f468811e460 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1596504294 0 0) 0x7f4688121550 con 0x7f468811e460 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 msgr2=0x7f4688139e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 --2- 172.21.15.129:0/2378870224 >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 0x7f4688139e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:51.021 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 >> v1:172.21.15.129:6789/0 conn(0x7f4688079370 legacy=0x7f46880797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688096610 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46881221c0 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688122de0 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4678008680 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4678010770 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f4678010970 con 0x7f468811e460 2020-01-26T15:26:51.022 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688056600 con 0x7f468811e460 2020-01-26T15:26:51.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.014+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f467804ce70 con 0x7f468811e460 2020-01-26T15:26:51.023 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.022+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4678032250 con 0x7f468811e460 2020-01-26T15:26:51.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.174+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f468805eb80 con 0x7f468811e460 2020-01-26T15:26:51.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.174+0000 7f46777fe700 1 -- 172.21.15.129:0/2378870224 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f46780324b0 con 0x7f468811e460 2020-01-26T15:26:51.175 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:51.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.174+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 >> v1:172.21.15.129:6800/16899 conn(0x7f466c03e0a0 legacy=0x7f466c0405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.174+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 >> v1:172.21.15.129:6790/0 conn(0x7f468811e460 legacy=0x7f4688120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:51.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.178+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 shutdown_connections 2020-01-26T15:26:51.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.178+0000 7f468759e700 1 --2- 172.21.15.129:0/2378870224 >> v2:172.21.15.129:6791/0 conn(0x7f4688137a40 0x7f4688139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:51.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.178+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 >> 172.21.15.129:0/2378870224 conn(0x7f4688098e10 msgr2=0x7f468807f030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:51.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.178+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 shutdown_connections 2020-01-26T15:26:51.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:51.178+0000 7f468759e700 1 -- 172.21.15.129:0/2378870224 wait complete. 2020-01-26T15:26:51.187 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:54.188 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 Processor -- start 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 -- start start 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f338005edd0 0x7f338005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f33800a6870 0x7f338007ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3380098000 con 0x7f33800804d0 2020-01-26T15:26:54.308 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f338005e050 con 0x7f33800a6870 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33870f1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f33800a6ca0 con 0x7f338005edd0 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33868f0700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f338005edd0 0x7f338005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33868f0700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f338005edd0 0x7f338005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33860ef700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f33800a6870 0x7f338007ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f3388353700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f33800804d0 0x7f33800247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40932/0 (socket says 172.21.15.129:40932) 2020-01-26T15:26:54.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f3388353700 1 -- 172.21.15.129:0/2635698923 learned_addr learned my addr 172.21.15.129:0/2635698923 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33860ef700 1 --2- 172.21.15.129:0/2635698923 >> v2:172.21.15.129:6790/0 conn(0x7f33800a6870 0x7f338007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991739150 0 0) 0x7f3380098000 con 0x7f33800804d0 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.302+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3370003230 con 0x7f33800804d0 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2893831972 0 0) 0x7f3370003230 con 0x7f33800804d0 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 >> v2:172.21.15.129:6791/0 conn(0x7f338005edd0 msgr2=0x7f338005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 --2- 172.21.15.129:0/2635698923 >> v2:172.21.15.129:6791/0 conn(0x7f338005edd0 0x7f338005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:54.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 >> v2:172.21.15.129:6790/0 conn(0x7f33800a6870 msgr2=0x7f338007ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 --2- 172.21.15.129:0/2635698923 >> v2:172.21.15.129:6790/0 conn(0x7f33800a6870 0x7f338007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380024fb0 con 0x7f33800804d0 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3378001710 con 0x7f33800804d0 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 >> v1:172.21.15.129:6789/0 conn(0x7f33800804d0 legacy=0x7f33800247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3370003230 con 0x7f33700045a0 2020-01-26T15:26:54.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3380098000 con 0x7f337000a7f0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338005e050 con 0x7f3370003860 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417068260 0 0) 0x7f3380098000 con 0x7f337000a7f0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337000e520 con 0x7f337000a7f0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607297279 0 0) 0x7f3370003230 con 0x7f33700045a0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3380098000 con 0x7f33700045a0 2020-01-26T15:26:54.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 -- 172.21.15.129:0/2635698923 >> v1:172.21.15.129:6791/0 conn(0x7f337000a7f0 legacy=0x7f337000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1922080513 0 0) 0x7f337000e520 con 0x7f337000a7f0 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 -- 172.21.15.129:0/2635698923 >> v1:172.21.15.129:6790/0 conn(0x7f33700045a0 legacy=0x7f33700049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 -- 172.21.15.129:0/2635698923 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370054470 con 0x7f3370003860 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f3388353700 1 -- 172.21.15.129:0/2635698923 reap_dead start 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3374008c80 tx=0x7f3374010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3374008c80 tx=0x7f3374010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f3374008c80 tx=0x7f3374010160).ready entity=mon.0 client_cookie=384938793d113ca8 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f3374008c80 tx=0x7f3374010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3378004820 con 0x7f3370003860 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f3374008c80 tx=0x7f3374010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33868f0700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f3374008c80 tx=0x7f3374010160).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374007310 con 0x7f3370003860 2020-01-26T15:26:54.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33858ee700 1 -- 172.21.15.129:0/2635698923 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3374007730 con 0x7f3370003860 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 -- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 msgr2=0x7f3370003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f3374008c80 tx=0x7f3374010160).stop 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 -- 172.21.15.129:0/2635698923 shutdown_connections 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 --2- 172.21.15.129:0/2635698923 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3370003860 0x7f3370003cd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 -- 172.21.15.129:0/2635698923 >> 172.21.15.129:0/2635698923 conn(0x7f3380098e70 msgr2=0x7f33800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 -- 172.21.15.129:0/2635698923 shutdown_connections 2020-01-26T15:26:54.315 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.306+0000 7f33870f1700 1 -- 172.21.15.129:0/2635698923 wait complete. 2020-01-26T15:26:54.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 Processor -- start 2020-01-26T15:26:54.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 -- start start 2020-01-26T15:26:54.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f338009cd60 0x7f338007d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:54.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338009d190 con 0x7f338007df40 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f338009c4e0 con 0x7f33800659a0 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33870f1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f338009f560 con 0x7f338009cd60 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f3388353700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f338007df40 0x7f338013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:40944/0 (socket says 172.21.15.129:40944) 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f3388353700 1 -- 172.21.15.129:0/3847013488 learned_addr learned my addr 172.21.15.129:0/3847013488 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33860ef700 -1 --2- 172.21.15.129:0/3847013488 >> v2:172.21.15.129:6790/0 conn(0x7f338009cd60 0x7f338007d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:54.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33860ef700 1 --2- 172.21.15.129:0/3847013488 >> v2:172.21.15.129:6790/0 conn(0x7f338009cd60 0x7f338007d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849166006 0 0) 0x7f338009d190 con 0x7f338007df40 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3368003230 con 0x7f338007df40 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934511359 0 0) 0x7f338009c4e0 con 0x7f33800659a0 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f338009d190 con 0x7f33800659a0 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1107719577 0 0) 0x7f338009d190 con 0x7f33800659a0 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f338009c4e0 con 0x7f33800659a0 2020-01-26T15:26:54.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3374008a00 con 0x7f33800659a0 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2788753602 0 0) 0x7f3368003230 con 0x7f338007df40 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f338009d190 con 0x7f338007df40 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3378004820 con 0x7f338007df40 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 >> v2:172.21.15.129:6790/0 conn(0x7f338009cd60 msgr2=0x7f338007d9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 --2- 172.21.15.129:0/3847013488 >> v2:172.21.15.129:6790/0 conn(0x7f338009cd60 0x7f338007d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 >> v1:172.21.15.129:6791/0 conn(0x7f33800659a0 legacy=0x7f338009dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 >> v1:172.21.15.129:6789/0 conn(0x7f338007df40 legacy=0x7f338013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3368003230 con 0x7f3368003a90 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f336800f820 con 0x7f3368003ec0 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338009f560 con 0x7f3368004f20 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.310+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:26:54.326 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922225676 0 0) 0x7f336800f820 con 0x7f3368003ec0 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f336800e810 con 0x7f3368003ec0 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21013975 0 0) 0x7f3368003230 con 0x7f3368003a90 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f336800f820 con 0x7f3368003a90 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 -- 172.21.15.129:0/3847013488 >> v1:172.21.15.129:6791/0 conn(0x7f3368003ec0 legacy=0x7f336800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 -- 172.21.15.129:0/3847013488 >> v1:172.21.15.129:6790/0 conn(0x7f3368003a90 legacy=0x7f33680097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f3380066020 con 0x7f3368004f20 2020-01-26T15:26:54.327 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338009f0c0 con 0x7f3368004f20 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3380065bc0 con 0x7f3368004f20 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f337400f700 con 0x7f3368004f20 2020-01-26T15:26:54.328 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400f900 con 0x7f3368004f20 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f337400b260 con 0x7f3368004f20 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c003360 con 0x7f3368004f20 2020-01-26T15:26:54.329 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.314+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f33740020c0 con 0x7f3368004f20 2020-01-26T15:26:54.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.318+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.330 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.318+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f337400faf0 con 0x7f3368004f20 2020-01-26T15:26:54.478 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.478+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f335c003790 con 0x7f3368004f20 2020-01-26T15:26:54.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.478+0000 7f33868f0700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:26:54.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.478+0000 7f337f7fe700 1 -- 172.21.15.129:0/3847013488 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3374034440 con 0x7f3368004f20 2020-01-26T15:26:54.479 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:54.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 >> v1:172.21.15.129:6800/16899 conn(0x7f3368048710 legacy=0x7f336804ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 msgr2=0x7f3368003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f33740086c0 tx=0x7f3374011d80).stop 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f3388353700 1 -- 172.21.15.129:0/3847013488 reap_dead start 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 shutdown_connections 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 --2- 172.21.15.129:0/3847013488 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3368004f20 0x7f3368003540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 >> 172.21.15.129:0/3847013488 conn(0x7f338005efe0 msgr2=0x7f338009fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 shutdown_connections 2020-01-26T15:26:54.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:54.482+0000 7f33870f1700 1 -- 172.21.15.129:0/3847013488 wait complete. 2020-01-26T15:26:54.491 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:26:57.492 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:26:57.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.606+0000 7f1f7ea9a700 1 Processor -- start 2020-01-26T15:26:57.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.606+0000 7f1f7ea9a700 1 -- start start 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 0x7f1f7814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7805ea20 con 0x7f1f7805e5f0 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f78098000 con 0x7f1f7805edd0 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7805e050 con 0x7f1f780a6870 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7e299700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1f7805edd0 0x7f1f7807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49254/0 (socket says 172.21.15.129:49254) 2020-01-26T15:26:57.613 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7e299700 1 -- 172.21.15.129:0/2327754510 learned_addr learned my addr 172.21.15.129:0/2327754510 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7fcfc700 -1 --2- 172.21.15.129:0/2327754510 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 0x7f1f7814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7fcfc700 1 --2- 172.21.15.129:0/2327754510 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 0x7f1f7814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931979255 0 0) 0x7f1f78098000 con 0x7f1f7805edd0 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f64003230 con 0x7f1f7805edd0 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694899045 0 0) 0x7f1f7805ea20 con 0x7f1f7805e5f0 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f78098000 con 0x7f1f7805e5f0 2020-01-26T15:26:57.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3553114115 0 0) 0x7f1f64003230 con 0x7f1f7805edd0 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 msgr2=0x7f1f7814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 --2- 172.21.15.129:0/2327754510 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 0x7f1f7814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 >> v1:172.21.15.129:6789/0 conn(0x7f1f7805e5f0 legacy=0x7f1f78149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f780a6ca0 con 0x7f1f7805edd0 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f74001a90 con 0x7f1f7805edd0 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1f74001d60 con 0x7f1f7805edd0 2020-01-26T15:26:57.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2327754510 >> v1:172.21.15.129:6790/0 conn(0x7f1f7805edd0 legacy=0x7f1f7807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7d297700 1 -- 172.21.15.129:0/2327754510 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f74004930 con 0x7f1f7805edd0 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2327754510 shutdown_connections 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 --2- 172.21.15.129:0/2327754510 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a6870 0x7f1f7814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.610+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2327754510 >> 172.21.15.129:0/2327754510 conn(0x7f1f78098e70 msgr2=0x7f1f780a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2327754510 shutdown_connections 2020-01-26T15:26:57.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2327754510 wait complete. 2020-01-26T15:26:57.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 Processor -- start 2020-01-26T15:26:57.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- start start 2020-01-26T15:26:57.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 0x7f1f780a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 0x7f1f780247b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7811ef40 con 0x7f1f78024d00 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1f780980a0 con 0x7f1f7809ec70 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7ea9a700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7809e960 con 0x7f1f780a1660 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7e299700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 0x7f1f780a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7e299700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 0x7f1f780a1110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7da98700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 0x7f1f780247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:26:57.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7fcfc700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f1f78024d00 0x7f1f7807c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46878/0 (socket says 172.21.15.129:46878) 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7fcfc700 1 -- 172.21.15.129:0/2020819019 learned_addr learned my addr 172.21.15.129:0/2020819019 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f7da98700 1 --2- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 0x7f1f780247b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556995085 0 0) 0x7f1f7811ef40 con 0x7f1f78024d00 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f60003230 con 0x7f1f78024d00 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 243795306 0 0) 0x7f1f60003230 con 0x7f1f78024d00 2020-01-26T15:26:57.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1f7811ef40 con 0x7f1f78024d00 2020-01-26T15:26:57.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.614+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f700026f0 con 0x7f1f78024d00 2020-01-26T15:26:57.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3282169589 0 0) 0x7f1f7811ef40 con 0x7f1f78024d00 2020-01-26T15:26:57.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 msgr2=0x7f1f780247b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:57.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 --2- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 0x7f1f780247b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:57.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 msgr2=0x7f1f780a1110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 --2- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 0x7f1f780a1110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7809f1f0 con 0x7f1f78024d00 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7809e150 con 0x7f1f78024d00 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f780252d0 con 0x7f1f78024d00 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1f70000f10 con 0x7f1f78024d00 2020-01-26T15:26:57.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1f700012f0 con 0x7f1f78024d00 2020-01-26T15:26:57.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f54003360 con 0x7f1f78024d00 2020-01-26T15:26:57.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f1f700014f0 con 0x7f1f78024d00 2020-01-26T15:26:57.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.618+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f1f7004bb20 con 0x7f1f78024d00 2020-01-26T15:26:57.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.622+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1f700310a0 con 0x7f1f78024d00 2020-01-26T15:26:57.780 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1f540037d0 con 0x7f1f78024d00 2020-01-26T15:26:57.781 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f6effd700 1 -- 172.21.15.129:0/2020819019 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1f7004a790 con 0x7f1f78024d00 2020-01-26T15:26:57.781 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:26:57.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 >> v1:172.21.15.129:6800/16899 conn(0x7f1f6003e0b0 legacy=0x7f1f600405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:57.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 >> v1:172.21.15.129:6791/0 conn(0x7f1f78024d00 legacy=0x7f1f7807c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:26:57.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 shutdown_connections 2020-01-26T15:26:57.783 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 --2- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6790/0 conn(0x7f1f7809ec70 0x7f1f780a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:57.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 --2- 172.21.15.129:0/2020819019 >> v2:172.21.15.129:6791/0 conn(0x7f1f780a1660 0x7f1f780247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:26:57.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 >> 172.21.15.129:0/2020819019 conn(0x7f1f780979b0 msgr2=0x7f1f781224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:26:57.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 shutdown_connections 2020-01-26T15:26:57.784 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:26:57.782+0000 7f1f7ea9a700 1 -- 172.21.15.129:0/2020819019 wait complete. 2020-01-26T15:26:57.795 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:00.796 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:00.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.914+0000 7f1aee6a1700 1 Processor -- start 2020-01-26T15:27:00.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.914+0000 7f1aee6a1700 1 -- start start 2020-01-26T15:27:00.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 0x7f1ae80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:00.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae80a6dc0 con 0x7f1ae8149040 2020-01-26T15:27:00.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae805ea20 con 0x7f1ae805edd0 2020-01-26T15:27:00.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae8098000 con 0x7f1ae805e5f0 2020-01-26T15:27:00.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aedea0700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f1ae805edd0 0x7f1ae807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46886/0 (socket says 172.21.15.129:46886) 2020-01-26T15:27:00.921 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aed69f700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 0x7f1ae80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:00.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aedea0700 1 -- 172.21.15.129:0/1576188582 learned_addr learned my addr 172.21.15.129:0/1576188582 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:00.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aef903700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1ae8149040 0x7f1ae814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49272/0 (socket says 172.21.15.129:49272) 2020-01-26T15:27:00.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aed69f700 1 --2- 172.21.15.129:0/1576188582 >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 0x7f1ae80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:00.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17584109 0 0) 0x7f1ae805ea20 con 0x7f1ae805edd0 2020-01-26T15:27:00.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad0003230 con 0x7f1ae805edd0 2020-01-26T15:27:00.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794572622 0 0) 0x7f1ae80a6dc0 con 0x7f1ae8149040 2020-01-26T15:27:00.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae805ea20 con 0x7f1ae8149040 2020-01-26T15:27:00.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 297628176 0 0) 0x7f1ad0003230 con 0x7f1ae805edd0 2020-01-26T15:27:00.923 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 msgr2=0x7f1ae80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:00.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 --2- 172.21.15.129:0/1576188582 >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 0x7f1ae80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:00.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 >> v1:172.21.15.129:6790/0 conn(0x7f1ae8149040 legacy=0x7f1ae814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:00.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae805e050 con 0x7f1ae805edd0 2020-01-26T15:27:00.924 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1ad8001a90 con 0x7f1ae805edd0 2020-01-26T15:27:00.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1ad8001d60 con 0x7f1ae805edd0 2020-01-26T15:27:00.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aece9e700 1 -- 172.21.15.129:0/1576188582 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1ad8004930 con 0x7f1ae805edd0 2020-01-26T15:27:00.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- 172.21.15.129:0/1576188582 >> v1:172.21.15.129:6791/0 conn(0x7f1ae805edd0 legacy=0x7f1ae807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:00.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- 172.21.15.129:0/1576188582 shutdown_connections 2020-01-26T15:27:00.925 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 --2- 172.21.15.129:0/1576188582 >> v2:172.21.15.129:6790/0 conn(0x7f1ae805e5f0 0x7f1ae80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:00.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- 172.21.15.129:0/1576188582 >> 172.21.15.129:0/1576188582 conn(0x7f1ae8098e70 msgr2=0x7f1ae80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:00.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- 172.21.15.129:0/1576188582 shutdown_connections 2020-01-26T15:27:00.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 -- 172.21.15.129:0/1576188582 wait complete. 2020-01-26T15:27:00.926 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.918+0000 7f1aee6a1700 1 Processor -- start 2020-01-26T15:27:00.927 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- start start 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 0x7f1ae80a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 0x7f1ae80a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae81231e0 con 0x7f1ae80a1730 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae81223a0 con 0x7f1ae809fdf0 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae80a4af0 con 0x7f1ae809ecb0 2020-01-26T15:27:00.931 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aed69f700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f1ae80a1730 0x7f1ae80247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46896/0 (socket says 172.21.15.129:46896) 2020-01-26T15:27:00.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aedea0700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 0x7f1ae80a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:00.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aed69f700 1 -- 172.21.15.129:0/3883961726 learned_addr learned my addr 172.21.15.129:0/3883961726 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:00.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aedea0700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 0x7f1ae80a0a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:00.932 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aef903700 -1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 0x7f1ae80a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:00.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aef903700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 0x7f1ae80a0fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:00.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268946434 0 0) 0x7f1ae81231e0 con 0x7f1ae80a1730 2020-01-26T15:27:00.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac8003230 con 0x7f1ae80a1730 2020-01-26T15:27:00.933 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2917505282 0 0) 0x7f1ac8003230 con 0x7f1ae80a1730 2020-01-26T15:27:00.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1ae81231e0 con 0x7f1ae80a1730 2020-01-26T15:27:00.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1adc002780 con 0x7f1ae80a1730 2020-01-26T15:27:00.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 791309478 0 0) 0x7f1ae81231e0 con 0x7f1ae80a1730 2020-01-26T15:27:00.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 msgr2=0x7f1ae80a0a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:00.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 0x7f1ae80a0a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:00.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 msgr2=0x7f1ae80a0fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:00.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 0x7f1ae80a0fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:00.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8024fb0 con 0x7f1ae80a1730 2020-01-26T15:27:00.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae8025280 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae813aa10 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1adc000f90 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.922+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1adc001370 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.926+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f1adc0015c0 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.926+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f1adc04bc10 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.926+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae8056600 con 0x7f1ae80a1730 2020-01-26T15:27:00.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:00.930+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1adc031190 con 0x7f1ae80a1730 2020-01-26T15:27:01.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1ae80a4ce0 con 0x7f1ae80a1730 2020-01-26T15:27:01.085 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1ae67fc700 1 -- 172.21.15.129:0/3883961726 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1adc04a880 con 0x7f1ae80a1730 2020-01-26T15:27:01.086 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:01.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 >> v1:172.21.15.129:6800/16899 conn(0x7f1ac803e0a0 legacy=0x7f1ac80405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:01.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 >> v1:172.21.15.129:6791/0 conn(0x7f1ae80a1730 legacy=0x7f1ae80247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:01.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 shutdown_connections 2020-01-26T15:27:01.088 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6790/0 conn(0x7f1ae809fdf0 0x7f1ae80a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:01.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.086+0000 7f1aee6a1700 1 --2- 172.21.15.129:0/3883961726 >> v2:172.21.15.129:6791/0 conn(0x7f1ae809ecb0 0x7f1ae80a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:01.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.090+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 >> 172.21.15.129:0/3883961726 conn(0x7f1ae805e5f0 msgr2=0x7f1ae809e350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:01.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.090+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 shutdown_connections 2020-01-26T15:27:01.089 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:01.090+0000 7f1aee6a1700 1 -- 172.21.15.129:0/3883961726 wait complete. 2020-01-26T15:27:01.103 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:04.104 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:04.222 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 Processor -- start 2020-01-26T15:27:04.222 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 -- start start 2020-01-26T15:27:04.222 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 0x7f00e8149040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:04.222 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 0x7f00e814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:04.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e805f5a0 con 0x7f00e80a62c0 2020-01-26T15:27:04.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f00e8080730 con 0x7f00e8097100 2020-01-26T15:27:04.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f00e805e760 con 0x7f00e8149590 2020-01-26T15:27:04.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ecf2e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f00e80a62c0 0x7f00e807ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46902/0 (socket says 172.21.15.129:46902) 2020-01-26T15:27:04.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ecf2e700 1 -- 172.21.15.129:0/211923867 learned_addr learned my addr 172.21.15.129:0/211923867 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:04.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ed72f700 -1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 0x7f00e814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:04.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e7fff700 -1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 0x7f00e8149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:04.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ed72f700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 0x7f00e814b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:04.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e7fff700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 0x7f00e8149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:04.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923718770 0 0) 0x7f00e805f5a0 con 0x7f00e80a62c0 2020-01-26T15:27:04.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d4003230 con 0x7f00e80a62c0 2020-01-26T15:27:04.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 276769660 0 0) 0x7f00d4003230 con 0x7f00e80a62c0 2020-01-26T15:27:04.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 msgr2=0x7f00e814b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:04.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 0x7f00e814b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:04.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 msgr2=0x7f00e8149040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:04.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 0x7f00e8149040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:04.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e805e0e0 con 0x7f00e80a62c0 2020-01-26T15:27:04.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f00e0001710 con 0x7f00e80a62c0 2020-01-26T15:27:04.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f00e0001aa0 con 0x7f00e80a62c0 2020-01-26T15:27:04.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00e77fe700 1 -- 172.21.15.129:0/211923867 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f00e0004760 con 0x7f00e80a62c0 2020-01-26T15:27:04.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.218+0000 7f00ee991700 1 -- 172.21.15.129:0/211923867 >> v1:172.21.15.129:6791/0 conn(0x7f00e80a62c0 legacy=0x7f00e807ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:04.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- 172.21.15.129:0/211923867 shutdown_connections 2020-01-26T15:27:04.227 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6791/0 conn(0x7f00e8149590 0x7f00e814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:04.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 --2- 172.21.15.129:0/211923867 >> v2:172.21.15.129:6790/0 conn(0x7f00e8097100 0x7f00e8149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:04.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- 172.21.15.129:0/211923867 >> 172.21.15.129:0/211923867 conn(0x7f00e8098e70 msgr2=0x7f00e80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:04.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- 172.21.15.129:0/211923867 shutdown_connections 2020-01-26T15:27:04.228 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- 172.21.15.129:0/211923867 wait complete. 2020-01-26T15:27:04.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 Processor -- start 2020-01-26T15:27:04.229 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- start start 2020-01-26T15:27:04.233 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 0x7f00e811f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:04.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 0x7f00e80792d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:04.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80a39a0 con 0x7f00e80a21f0 2020-01-26T15:27:04.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f00e811eb00 con 0x7f00e8078ea0 2020-01-26T15:27:04.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ee991700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f00e809e150 con 0x7f00e80a33e0 2020-01-26T15:27:04.234 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ecf2e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f00e80a21f0 0x7f00e811f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46908/0 (socket says 172.21.15.129:46908) 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ecf2e700 1 -- 172.21.15.129:0/2075952158 learned_addr learned my addr 172.21.15.129:0/2075952158 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e7fff700 -1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 0x7f00e811f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e7fff700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 0x7f00e811f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ed72f700 -1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 0x7f00e80792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00ed72f700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 0x7f00e80792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056756925 0 0) 0x7f00e80a39a0 con 0x7f00e80a21f0 2020-01-26T15:27:04.235 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00cc003230 con 0x7f00e80a21f0 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4205144367 0 0) 0x7f00cc003230 con 0x7f00e80a21f0 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.222+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f00e80a39a0 con 0x7f00e80a21f0 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f00e0001420 con 0x7f00e80a21f0 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 820464505 0 0) 0x7f00e80a39a0 con 0x7f00e80a21f0 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 msgr2=0x7f00e811f8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 0x7f00e811f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 msgr2=0x7f00e80792d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:04.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 0x7f00e80792d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8079820 con 0x7f00e80a21f0 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8079af0 con 0x7f00e80a21f0 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e813a960 con 0x7f00e80a21f0 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f00e00017b0 con 0x7f00e80a21f0 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f00e0004e10 con 0x7f00e80a21f0 2020-01-26T15:27:04.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c0003360 con 0x7f00e80a21f0 2020-01-26T15:27:04.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f00e0010850 con 0x7f00e80a21f0 2020-01-26T15:27:04.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.226+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f00e004bb00 con 0x7f00e80a21f0 2020-01-26T15:27:04.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.234+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f00e805e0e0 con 0x7f00e80a21f0 2020-01-26T15:27:04.387 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.386+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f00c00037d0 con 0x7f00e80a21f0 2020-01-26T15:27:04.388 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00e57fa700 1 -- 172.21.15.129:0/2075952158 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f00e0030e80 con 0x7f00e80a21f0 2020-01-26T15:27:04.388 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 >> v1:172.21.15.129:6800/16899 conn(0x7f00cc03e070 legacy=0x7f00cc040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 >> v1:172.21.15.129:6791/0 conn(0x7f00e80a21f0 legacy=0x7f00e811f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 shutdown_connections 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6790/0 conn(0x7f00e8078ea0 0x7f00e80792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 --2- 172.21.15.129:0/2075952158 >> v2:172.21.15.129:6791/0 conn(0x7f00e80a33e0 0x7f00e811f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 >> 172.21.15.129:0/2075952158 conn(0x7f00e8098e10 msgr2=0x7f00e807ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:04.391 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 shutdown_connections 2020-01-26T15:27:04.392 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:04.390+0000 7f00ee991700 1 -- 172.21.15.129:0/2075952158 wait complete. 2020-01-26T15:27:04.405 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:07.406 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:07.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e57fff700 1 Processor -- start 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e57fff700 1 -- start start 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5805ea20 con 0x7f5e5805e5f0 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e58098000 con 0x7f5e5805edd0 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5805e050 con 0x7f5e580a6870 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e56ffd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f5e5805e5f0 0x7f5e58149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41000/0 (socket says 172.21.15.129:41000) 2020-01-26T15:27:07.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e56ffd700 1 -- 172.21.15.129:0/1607993483 learned_addr learned my addr 172.21.15.129:0/1607993483 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120544326 0 0) 0x7f5e5805ea20 con 0x7f5e5805e5f0 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e38003230 con 0x7f5e5805e5f0 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976037745 0 0) 0x7f5e58098000 con 0x7f5e5805edd0 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5805ea20 con 0x7f5e5805edd0 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452030282 0 0) 0x7f5e5805e050 con 0x7f5e580a6870 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.522+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e58098000 con 0x7f5e580a6870 2020-01-26T15:27:07.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1200315653 0 0) 0x7f5e38003230 con 0x7f5e5805e5f0 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 >> v1:172.21.15.129:6791/0 conn(0x7f5e580a6870 legacy=0x7f5e5814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 >> v1:172.21.15.129:6790/0 conn(0x7f5e5805edd0 legacy=0x7f5e5807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580a6ca0 con 0x7f5e5805e5f0 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5e40001a90 con 0x7f5e5805e5f0 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 >> v1:172.21.15.129:6789/0 conn(0x7f5e5805e5f0 legacy=0x7f5e58149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:07.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5e38003230 con 0x7f5e38003d50 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5e5805ea20 con 0x7f5e3800ad40 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380051d0 con 0x7f5e38004da0 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735373413 0 0) 0x7f5e5805ea20 con 0x7f5e3800ad40 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e58098000 con 0x7f5e3800ad40 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046659476 0 0) 0x7f5e38003230 con 0x7f5e38003d50 2020-01-26T15:27:07.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5805ea20 con 0x7f5e38003d50 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 -- 172.21.15.129:0/1607993483 >> v1:172.21.15.129:6791/0 conn(0x7f5e3800ad40 legacy=0x7f5e3800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 -- 172.21.15.129:0/1607993483 >> v1:172.21.15.129:6790/0 conn(0x7f5e38003d50 legacy=0x7f5e380045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 -- 172.21.15.129:0/1607993483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380109b0 con 0x7f5e38004da0 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5e400018a0 tx=0x7f5e400504f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5e400018a0 tx=0x7f5e400504f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f5e400018a0 tx=0x7f5e400504f0).ready entity=mon.0 client_cookie=b88d96254cc561d6 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:07.559 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5e400018a0 tx=0x7f5e400504f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f5e40052310 con 0x7f5e38004da0 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5e400018a0 tx=0x7f5e400504f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f5e400018a0 tx=0x7f5e400504f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40052510 con 0x7f5e38004da0 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e567fc700 1 -- 172.21.15.129:0/1607993483 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f5e400528b0 con 0x7f5e38004da0 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 -- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 msgr2=0x7f5e3800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.560 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f5e400018a0 tx=0x7f5e400504f0).stop 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 -- 172.21.15.129:0/1607993483 shutdown_connections 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 --2- 172.21.15.129:0/1607993483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e38004da0 0x7f5e3800a7f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 -- 172.21.15.129:0/1607993483 >> 172.21.15.129:0/1607993483 conn(0x7f5e58098e70 msgr2=0x7f5e580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 -- 172.21.15.129:0/1607993483 shutdown_connections 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.526+0000 7f5e57fff700 1 -- 172.21.15.129:0/1607993483 wait complete. 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e57fff700 1 Processor -- start 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e57fff700 1 -- start start 2020-01-26T15:27:07.561 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5812f8d0 con 0x7f5e580a2de0 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5809e7a0 con 0x7f5e581394d0 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e57fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580a3e60 con 0x7f5e580a29b0 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e577fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f5e580a29b0 0x7f5e5811e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46928/0 (socket says 172.21.15.129:46928) 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e56ffd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f5e580a2de0 0x7f5e5812f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41014/0 (socket says 172.21.15.129:41014) 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e577fe700 1 -- 172.21.15.129:0/3168931792 learned_addr learned my addr 172.21.15.129:0/3168931792 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851931632 0 0) 0x7f5e400018e0 con 0x7f5e580a2de0 2020-01-26T15:27:07.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003230 con 0x7f5e580a2de0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321201717 0 0) 0x7f5e5809e7a0 con 0x7f5e581394d0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400018e0 con 0x7f5e581394d0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136981814 0 0) 0x7f5e580a3e60 con 0x7f5e580a29b0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5809e7a0 con 0x7f5e580a29b0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3096183150 0 0) 0x7f5e400018e0 con 0x7f5e581394d0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e580a3e60 con 0x7f5e581394d0 2020-01-26T15:27:07.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5e50001380 con 0x7f5e581394d0 2020-01-26T15:27:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 838602851 0 0) 0x7f5e30003230 con 0x7f5e580a2de0 2020-01-26T15:27:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e400018e0 con 0x7f5e580a2de0 2020-01-26T15:27:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2914362063 0 0) 0x7f5e5809e7a0 con 0x7f5e580a29b0 2020-01-26T15:27:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e30003230 con 0x7f5e580a29b0 2020-01-26T15:27:07.564 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5e40001b50 con 0x7f5e580a2de0 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6791/0 conn(0x7f5e580a29b0 legacy=0x7f5e5811e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6790/0 conn(0x7f5e581394d0 legacy=0x7f5e5813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6789/0 conn(0x7f5e580a2de0 legacy=0x7f5e5812f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5e5809e7a0 con 0x7f5e3000b170 2020-01-26T15:27:07.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5e3000fdd0 con 0x7f5e300045a0 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.530+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30011010 con 0x7f5e300087e0 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6791/0 conn(0x7f5e300045a0 legacy=0x7f5e300049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6790/0 conn(0x7f5e3000b170 legacy=0x7f5e3000d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138301443 0 0) 0x7f5e3000fdd0 con 0x7f5e300045a0 2020-01-26T15:27:07.566 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f5e58122db0 con 0x7f5e300087e0 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580a29b0 con 0x7f5e300087e0 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5811e060 con 0x7f5e300087e0 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f5e40054b80 con 0x7f5e300087e0 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4004a980 con 0x7f5e300087e0 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f5e4004ab70 con 0x7f5e300087e0 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34003360 con 0x7f5e300087e0 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.534+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f5e5812f8d0 con 0x7f5e300087e0 2020-01-26T15:27:07.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.538+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.538+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f5e40078df0 con 0x7f5e300087e0 2020-01-26T15:27:07.693 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.694+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e34003790 con 0x7f5e300087e0 2020-01-26T15:27:07.694 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.694+0000 7f5e56ffd700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:07.695 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.694+0000 7f5e4ffff700 1 -- 172.21.15.129:0/3168931792 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f5e400781d0 con 0x7f5e300087e0 2020-01-26T15:27:07.695 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:07.696 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 >> v1:172.21.15.129:6800/16899 conn(0x7f5e30048b20 legacy=0x7f5e3004b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.696 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 msgr2=0x7f5e3000ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:07.696 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 --2- 172.21.15.129:0/3168931792 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f5e300087e0 0x7f5e3000ac20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f5e50000eb0 tx=0x7f5e500011f0).stop 2020-01-26T15:27:07.696 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e5da5a700 1 -- 172.21.15.129:0/3168931792 reap_dead start 2020-01-26T15:27:07.696 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 shutdown_connections 2020-01-26T15:27:07.697 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 >> 172.21.15.129:0/3168931792 conn(0x7f5e580a67d0 msgr2=0x7f5e5807f050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:07.697 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 shutdown_connections 2020-01-26T15:27:07.697 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:07.698+0000 7f5e57fff700 1 -- 172.21.15.129:0/3168931792 wait complete. 2020-01-26T15:27:07.707 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:10.708 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:10.829 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.822+0000 7f1d55fb8700 1 Processor -- start 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.822+0000 7f1d55fb8700 1 -- start start 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d55fb8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5005ea20 con 0x7f1d500a6870 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d55fb8700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d50098000 con 0x7f1d5005edd0 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d55fb8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5005e050 con 0x7f1d5005e5f0 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d557b7700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1d5005edd0 0x7f1d5007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49326/0 (socket says 172.21.15.129:49326) 2020-01-26T15:27:10.830 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d557b7700 1 -- 172.21.15.129:0/2329424552 learned_addr learned my addr 172.21.15.129:0/2329424552 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191778121 0 0) 0x7f1d5005ea20 con 0x7f1d500a6870 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d40003230 con 0x7f1d500a6870 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623504886 0 0) 0x7f1d50098000 con 0x7f1d5005edd0 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5005ea20 con 0x7f1d5005edd0 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666209234 0 0) 0x7f1d5005e050 con 0x7f1d5005e5f0 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d50098000 con 0x7f1d5005e5f0 2020-01-26T15:27:10.831 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1615643233 0 0) 0x7f1d40003230 con 0x7f1d500a6870 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 >> v1:172.21.15.129:6791/0 conn(0x7f1d5005e5f0 legacy=0x7f1d50149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 >> v1:172.21.15.129:6790/0 conn(0x7f1d5005edd0 legacy=0x7f1d5007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500a6ca0 con 0x7f1d500a6870 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1d48001640 con 0x7f1d500a6870 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 >> v1:172.21.15.129:6789/0 conn(0x7f1d500a6870 legacy=0x7f1d5014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 --2- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 0x7f1d4000e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:10.832 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1d40003230 con 0x7f1d40004da0 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1d5005e050 con 0x7f1d40003d20 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400051d0 con 0x7f1d4000c000 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d5721a700 1 --2- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 0x7f1d4000e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146947444 0 0) 0x7f1d5005e050 con 0x7f1d40003d20 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d4000e990 con 0x7f1d40003d20 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359477729 0 0) 0x7f1d40003230 con 0x7f1d40004da0 2020-01-26T15:27:10.833 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5005e050 con 0x7f1d40004da0 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2002151955 0 0) 0x7f1d5005e050 con 0x7f1d40004da0 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 msgr2=0x7f1d4000e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 --2- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 0x7f1d4000e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 >> v1:172.21.15.129:6791/0 conn(0x7f1d40003d20 legacy=0x7f1d400045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400109b0 con 0x7f1d40004da0 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1d3c001590 con 0x7f1d40004da0 2020-01-26T15:27:10.834 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d5721a700 1 --2- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 0x7f1d4000e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1d3c001810 con 0x7f1d40004da0 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d4ffff700 1 -- 172.21.15.129:0/2329424552 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1d3c001c30 con 0x7f1d40004da0 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.826+0000 7f1d55fb8700 1 -- 172.21.15.129:0/2329424552 >> v1:172.21.15.129:6790/0 conn(0x7f1d40004da0 legacy=0x7f1d4000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 -- 172.21.15.129:0/2329424552 shutdown_connections 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 --2- 172.21.15.129:0/2329424552 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d4000c000 0x7f1d4000e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:10.835 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 -- 172.21.15.129:0/2329424552 >> 172.21.15.129:0/2329424552 conn(0x7f1d50098e70 msgr2=0x7f1d500a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:10.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 -- 172.21.15.129:0/2329424552 shutdown_connections 2020-01-26T15:27:10.836 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 -- 172.21.15.129:0/2329424552 wait complete. 2020-01-26T15:27:10.839 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 Processor -- start 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.830+0000 7f1d55fb8700 1 -- start start 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1d50136180 0x7f1d501385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5009a610 con 0x7f1d500a0460 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5007d7c0 con 0x7f1d500a11e0 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1d501216f0 con 0x7f1d50136180 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1d50136180 0x7f1d501385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:10.840 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1d50136180 0x7f1d501385c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d557b7700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f1d500a0460 0x7f1d50099e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41038/0 (socket says 172.21.15.129:41038) 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d54fb6700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f1d500a11e0 0x7f1d5007cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46956/0 (socket says 172.21.15.129:46956) 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d557b7700 1 -- 172.21.15.129:0/3407901308 learned_addr learned my addr 172.21.15.129:0/3407901308 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038581137 0 0) 0x7f1d5007d7c0 con 0x7f1d500a11e0 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d30003230 con 0x7f1d500a11e0 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157498373 0 0) 0x7f1d5009a610 con 0x7f1d500a0460 2020-01-26T15:27:10.841 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d5007d7c0 con 0x7f1d500a0460 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1775328619 0 0) 0x7f1d30003230 con 0x7f1d500a11e0 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d5009a610 con 0x7f1d500a11e0 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1d3c001a00 con 0x7f1d500a11e0 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2151910466 0 0) 0x7f1d5007d7c0 con 0x7f1d500a0460 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1d30003230 con 0x7f1d500a0460 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1d44001e50 con 0x7f1d500a0460 2020-01-26T15:27:10.842 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 >> v2:172.21.15.129:6790/0 conn(0x7f1d50136180 msgr2=0x7f1d501385c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 --2- 172.21.15.129:0/3407901308 >> v2:172.21.15.129:6790/0 conn(0x7f1d50136180 0x7f1d501385c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 >> v1:172.21.15.129:6791/0 conn(0x7f1d500a11e0 legacy=0x7f1d5007cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 >> v1:172.21.15.129:6789/0 conn(0x7f1d500a0460 legacy=0x7f1d50099e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1d5007d7c0 con 0x7f1d30003d40 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1d3000f9a0 con 0x7f1d30004f00 2020-01-26T15:27:10.843 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501216f0 con 0x7f1d3000c000 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511281319 0 0) 0x7f1d5007d7c0 con 0x7f1d30003d40 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3000fbd0 con 0x7f1d30003d40 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 -- 172.21.15.129:0/3407901308 >> v1:172.21.15.129:6791/0 conn(0x7f1d30004f00 legacy=0x7f1d30003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 -- 172.21.15.129:0/3407901308 >> v1:172.21.15.129:6790/0 conn(0x7f1d30003d40 legacy=0x7f1d3000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f1d50121bd0 con 0x7f1d3000c000 2020-01-26T15:27:10.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5009fe90 con 0x7f1d3000c000 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d500252c0 con 0x7f1d3000c000 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1d48001ac0 con 0x7f1d3000c000 2020-01-26T15:27:10.845 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48001cc0 con 0x7f1d3000c000 2020-01-26T15:27:10.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.834+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28003360 con 0x7f1d3000c000 2020-01-26T15:27:10.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.838+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1d48052900 con 0x7f1d3000c000 2020-01-26T15:27:10.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.838+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.838+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f1d48090a00 con 0x7f1d3000c000 2020-01-26T15:27:10.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.842+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:10.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.842+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1d48057060 con 0x7f1d3000c000 2020-01-26T15:27:11.001 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.998+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1d28003790 con 0x7f1d3000c000 2020-01-26T15:27:11.001 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.998+0000 7f1d5721a700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:10.998+0000 7f1d4dffb700 1 -- 172.21.15.129:0/3407901308 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1d48076bb0 con 0x7f1d3000c000 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 >> v1:172.21.15.129:6800/16899 conn(0x7f1d30048830 legacy=0x7f1d3004ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 msgr2=0x7f1d3000e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f1d44001a70 tx=0x7f1d480516a0).stop 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d5721a700 1 -- 172.21.15.129:0/3407901308 reap_dead start 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 shutdown_connections 2020-01-26T15:27:11.002 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 --2- 172.21.15.129:0/3407901308 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f1d3000c000 0x7f1d3000e440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:11.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 >> 172.21.15.129:0/3407901308 conn(0x7f1d500a5520 msgr2=0x7f1d501226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:11.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 shutdown_connections 2020-01-26T15:27:11.003 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:11.002+0000 7f1d55fb8700 1 -- 172.21.15.129:0/3407901308 wait complete. 2020-01-26T15:27:11.003 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:11.017 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:14.018 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:14.136 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 Processor -- start 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 -- start start 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 0x7f4a1405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 0x7f4a1407ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a14098000 con 0x7f4a140804d0 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1405e050 con 0x7f4a1405edd0 2020-01-26T15:27:14.137 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140a6ca0 con 0x7f4a140a6870 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a12d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 0x7f4a1405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1259c700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 0x7f4a1407ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a12d9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 0x7f4a1405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a18a51700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f4a140804d0 0x7f4a140247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46972/0 (socket says 172.21.15.129:46972) 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1259c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 0x7f4a1407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a18a51700 1 -- 172.21.15.129:0/2184361945 learned_addr learned my addr 172.21.15.129:0/2184361945 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:14.138 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370224863 0 0) 0x7f4a14098000 con 0x7f4a140804d0 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a00003230 con 0x7f4a140804d0 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3662681833 0 0) 0x7f4a00003230 con 0x7f4a140804d0 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 msgr2=0x7f4a1407ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 --2- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 0x7f4a1407ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 msgr2=0x7f4a1405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 --2- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 0x7f4a1405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14024fb0 con 0x7f4a140804d0 2020-01-26T15:27:14.139 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4a0c001710 con 0x7f4a140804d0 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4a0c001aa0 con 0x7f4a140804d0 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a1359e700 1 -- 172.21.15.129:0/2184361945 >> v1:172.21.15.129:6791/0 conn(0x7f4a140804d0 legacy=0x7f4a140247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.134+0000 7f4a11d9b700 1 -- 172.21.15.129:0/2184361945 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4a0c004760 con 0x7f4a140804d0 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- 172.21.15.129:0/2184361945 shutdown_connections 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 --2- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6790/0 conn(0x7f4a1405edd0 0x7f4a1405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 --2- 172.21.15.129:0/2184361945 >> v2:172.21.15.129:6791/0 conn(0x7f4a140a6870 0x7f4a1407ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:14.140 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- 172.21.15.129:0/2184361945 >> 172.21.15.129:0/2184361945 conn(0x7f4a14098e70 msgr2=0x7f4a140a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:14.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- 172.21.15.129:0/2184361945 shutdown_connections 2020-01-26T15:27:14.141 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- 172.21.15.129:0/2184361945 wait complete. 2020-01-26T15:27:14.145 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 Processor -- start 2020-01-26T15:27:14.145 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- start start 2020-01-26T15:27:14.145 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a14139970 0x7f4a1413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1409de10 con 0x7f4a1407ea00 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140a1440 con 0x7f4a140a1010 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a1359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1409e360 con 0x7f4a14139970 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a18a51700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a14139970 0x7f4a1413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a18a51700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4a14139970 0x7f4a1413bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a12d9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f4a140a1010 0x7f4a14125c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46974/0 (socket says 172.21.15.129:46974) 2020-01-26T15:27:14.146 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a12d9d700 1 -- 172.21.15.129:0/2893994102 learned_addr learned my addr 172.21.15.129:0/2893994102 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151875866 0 0) 0x7f49fc001f80 con 0x7f4a140a1010 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f8003230 con 0x7f4a140a1010 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489604371 0 0) 0x7f4a1409de10 con 0x7f4a1407ea00 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc001f80 con 0x7f4a1407ea00 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1019007430 0 0) 0x7f49f8003230 con 0x7f4a140a1010 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4a1409de10 con 0x7f4a140a1010 2020-01-26T15:27:14.147 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f49fc0029b0 con 0x7f4a140a1010 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2523745483 0 0) 0x7f49fc001f80 con 0x7f4a1407ea00 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49f8003230 con 0x7f4a1407ea00 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.138+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4a040019d0 con 0x7f4a1407ea00 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 >> v2:172.21.15.129:6790/0 conn(0x7f4a14139970 msgr2=0x7f4a1413bdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 --2- 172.21.15.129:0/2893994102 >> v2:172.21.15.129:6790/0 conn(0x7f4a14139970 0x7f4a1413bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 >> v1:172.21.15.129:6791/0 conn(0x7f4a140a1010 legacy=0x7f4a14125c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 >> v1:172.21.15.129:6789/0 conn(0x7f4a1407ea00 legacy=0x7f4a1407ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.148 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f4a1409de10 con 0x7f49f8004da0 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f49fc001f80 con 0x7f49f8003ec0 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409e360 con 0x7f49f800c000 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427044621 0 0) 0x7f49fc001f80 con 0x7f49f8003ec0 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49f800e990 con 0x7f49f8003ec0 2020-01-26T15:27:14.149 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583169367 0 0) 0x7f4a1409de10 con 0x7f49f8004da0 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc001f80 con 0x7f49f8004da0 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 -- 172.21.15.129:0/2893994102 >> v1:172.21.15.129:6791/0 conn(0x7f49f8003ec0 legacy=0x7f49f80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 -- 172.21.15.129:0/2893994102 >> v1:172.21.15.129:6790/0 conn(0x7f49f8004da0 legacy=0x7f49f800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f4a1411e300 con 0x7f49f800c000 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1407f630 con 0x7f49f800c000 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1411f160 con 0x7f49f800c000 2020-01-26T15:27:14.150 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f4a0c013060 con 0x7f49f800c000 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.151 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c007330 con 0x7f49f800c000 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec003360 con 0x7f49f800c000 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f4a0c007520 con 0x7f49f800c000 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.142+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f4a0c04c8b0 con 0x7f49f800c000 2020-01-26T15:27:14.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.146+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.146+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f4a0c032a60 con 0x7f49f800c000 2020-01-26T15:27:14.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.306+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f49ec003790 con 0x7f49f800c000 2020-01-26T15:27:14.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.306+0000 7f4a18a51700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:14.307 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.306+0000 7f4a0b7fe700 1 -- 172.21.15.129:0/2893994102 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f4a0c032cc0 con 0x7f49f800c000 2020-01-26T15:27:14.308 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:14.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 >> v1:172.21.15.129:6800/16899 conn(0x7f49f8048510 legacy=0x7f49f804aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 msgr2=0x7f49f800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:14.309 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a18a51700 1 -- 172.21.15.129:0/2893994102 reap_dead start 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f4a0c0011d0 tx=0x7f4a0c010ab0).stop 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 shutdown_connections 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 --2- 172.21.15.129:0/2893994102 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f49f800c000 0x7f49f800e440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 >> 172.21.15.129:0/2893994102 conn(0x7f4a140255c0 msgr2=0x7f4a140a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 shutdown_connections 2020-01-26T15:27:14.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:14.310+0000 7f4a1359e700 1 -- 172.21.15.129:0/2893994102 wait complete. 2020-01-26T15:27:14.320 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:17.321 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:17.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 Processor -- start 2020-01-26T15:27:17.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 -- start start 2020-01-26T15:27:17.441 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 0x7f33c414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40a5b80 con 0x7f33c40a5750 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c4080440 con 0x7f33c4146c30 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c8fe5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f33c40a43f0 con 0x7f33c414a880 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c259c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f33c4146c30 0x7f33c4149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:46990/0 (socket says 172.21.15.129:46990) 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c259c700 1 -- 172.21.15.129:0/4117814669 learned_addr learned my addr 172.21.15.129:0/4117814669 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:17.442 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c2d9d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f33c40a5750 0x7f33c40a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41072/0 (socket says 172.21.15.129:41072) 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c359e700 -1 --2- 172.21.15.129:0/4117814669 >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 0x7f33c414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c359e700 1 --2- 172.21.15.129:0/4117814669 >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 0x7f33c414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618862273 0 0) 0x7f33c4080440 con 0x7f33c4146c30 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ac003230 con 0x7f33c4146c30 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077611036 0 0) 0x7f33c40a5b80 con 0x7f33c40a5750 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c4080440 con 0x7f33c40a5750 2020-01-26T15:27:17.443 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.438+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3067906885 0 0) 0x7f33ac003230 con 0x7f33c4146c30 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 msgr2=0x7f33c414ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 --2- 172.21.15.129:0/4117814669 >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 0x7f33c414ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 >> v1:172.21.15.129:6789/0 conn(0x7f33c40a5750 legacy=0x7f33c40a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40a4e00 con 0x7f33c4146c30 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f33b8001710 con 0x7f33c4146c30 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f33b80019e0 con 0x7f33c4146c30 2020-01-26T15:27:17.444 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c1d9b700 1 -- 172.21.15.129:0/4117814669 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f33b80045b0 con 0x7f33c4146c30 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- 172.21.15.129:0/4117814669 >> v1:172.21.15.129:6791/0 conn(0x7f33c4146c30 legacy=0x7f33c4149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- 172.21.15.129:0/4117814669 shutdown_connections 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 --2- 172.21.15.129:0/4117814669 >> v2:172.21.15.129:6791/0 conn(0x7f33c414a880 0x7f33c414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- 172.21.15.129:0/4117814669 >> 172.21.15.129:0/4117814669 conn(0x7f33c405e050 msgr2=0x7f33c4098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- 172.21.15.129:0/4117814669 shutdown_connections 2020-01-26T15:27:17.445 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- 172.21.15.129:0/4117814669 wait complete. 2020-01-26T15:27:17.447 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 Processor -- start 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- start start 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 0x7f33c409a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 0x7f33c413ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c409b090 con 0x7f33c409ac60 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f33c4065b40 con 0x7f33c40907d0 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.442+0000 7f33c8fe5700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f33c4066140 con 0x7f33c407f200 2020-01-26T15:27:17.448 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c2d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 0x7f33c409a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c259c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f33c409ac60 0x7f33c407ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49382/0 (socket says 172.21.15.129:49382) 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c359e700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 0x7f33c413ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c259c700 1 -- 172.21.15.129:0/3574135485 learned_addr learned my addr 172.21.15.129:0/3574135485 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c359e700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 0x7f33c413ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c2d9d700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 0x7f33c409a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871486009 0 0) 0x7f33b80044f0 con 0x7f33c409ac60 2020-01-26T15:27:17.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a8003230 con 0x7f33c409ac60 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2401946321 0 0) 0x7f33a8003230 con 0x7f33c409ac60 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f33b80044f0 con 0x7f33c409ac60 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f33b80015d0 con 0x7f33c409ac60 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1283605750 0 0) 0x7f33b80044f0 con 0x7f33c409ac60 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 msgr2=0x7f33c413ac20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 0x7f33c413ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 msgr2=0x7f33c409a710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:17.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 0x7f33c409a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40903a0 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c40940c0 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c407f7d0 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f33b8004b30 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f33b8004ed0 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c003360 con 0x7f33c409ac60 2020-01-26T15:27:17.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.446+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f33b8010910 con 0x7f33c409ac60 2020-01-26T15:27:17.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.450+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f33c409b090 con 0x7f33c409ac60 2020-01-26T15:27:17.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.454+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f33b8031270 con 0x7f33c409ac60 2020-01-26T15:27:17.611 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f339c0037d0 con 0x7f33c409ac60 2020-01-26T15:27:17.612 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33b37fe700 1 -- 172.21.15.129:0/3574135485 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f33b8031e20 con 0x7f33c409ac60 2020-01-26T15:27:17.612 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 >> v1:172.21.15.129:6800/16899 conn(0x7f33a803e200 legacy=0x7f33a8040710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 >> v1:172.21.15.129:6790/0 conn(0x7f33c409ac60 legacy=0x7f33c407ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 shutdown_connections 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6791/0 conn(0x7f33c407f200 0x7f33c413ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 --2- 172.21.15.129:0/3574135485 >> v2:172.21.15.129:6790/0 conn(0x7f33c40907d0 0x7f33c409a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:17.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 >> 172.21.15.129:0/3574135485 conn(0x7f33c40a6c50 msgr2=0x7f33c4094ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:17.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 shutdown_connections 2020-01-26T15:27:17.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:17.614+0000 7f33c8fe5700 1 -- 172.21.15.129:0/3574135485 wait complete. 2020-01-26T15:27:17.630 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:20.631 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 Processor -- start 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 -- start start 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 0x7f79e405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 0x7f79e414b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e4098000 con 0x7f79e40a6870 2020-01-26T15:27:20.750 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f79e405e050 con 0x7f79e4149040 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79ea1d7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40a6ca0 con 0x7f79e405edd0 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e91d5700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f79e40a6870 0x7f79e407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49388/0 (socket says 172.21.15.129:49388) 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e91d5700 1 -- 172.21.15.129:0/3530464775 learned_addr learned my addr 172.21.15.129:0/3530464775 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e99d6700 -1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 0x7f79e405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79eb439700 -1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 0x7f79e414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e99d6700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 0x7f79e405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:20.751 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79eb439700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 0x7f79e414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86959403 0 0) 0x7f79e4098000 con 0x7f79e40a6870 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.746+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79cc003230 con 0x7f79e40a6870 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1122212544 0 0) 0x7f79cc003230 con 0x7f79e40a6870 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 msgr2=0x7f79e405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 0x7f79e405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 msgr2=0x7f79e414b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 0x7f79e414b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:20.752 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e414c9e0 con 0x7f79e40a6870 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f79d8001710 con 0x7f79e40a6870 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f79d8001aa0 con 0x7f79e40a6870 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e89d4700 1 -- 172.21.15.129:0/3530464775 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f79d8004760 con 0x7f79e40a6870 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3530464775 >> v1:172.21.15.129:6790/0 conn(0x7f79e40a6870 legacy=0x7f79e407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3530464775 shutdown_connections 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6790/0 conn(0x7f79e4149040 0x7f79e414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:20.753 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 --2- 172.21.15.129:0/3530464775 >> v2:172.21.15.129:6791/0 conn(0x7f79e405edd0 0x7f79e405e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:20.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3530464775 >> 172.21.15.129:0/3530464775 conn(0x7f79e4098e70 msgr2=0x7f79e40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:20.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3530464775 shutdown_connections 2020-01-26T15:27:20.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3530464775 wait complete. 2020-01-26T15:27:20.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 Processor -- start 2020-01-26T15:27:20.754 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- start start 2020-01-26T15:27:20.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e409c0d0 con 0x7f79e407f3c0 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e409a850 con 0x7f79e409bca0 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79ea1d7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e407f7f0 con 0x7f79e407ef90 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e91d5700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f79e407ef90 0x7f79e41362e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47008/0 (socket says 172.21.15.129:47008) 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.750+0000 7f79e91d5700 1 -- 172.21.15.129:0/3222153079 learned_addr learned my addr 172.21.15.129:0/3222153079 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052127180 0 0) 0x7f79e407f7f0 con 0x7f79e407ef90 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c4003230 con 0x7f79e407ef90 2020-01-26T15:27:20.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352295758 0 0) 0x7f79e409a850 con 0x7f79e409bca0 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e407f7f0 con 0x7f79e409bca0 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036503464 0 0) 0x7f79e409c0d0 con 0x7f79e407f3c0 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e409a850 con 0x7f79e407f3c0 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1742869019 0 0) 0x7f79c4003230 con 0x7f79e407ef90 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79e409c0d0 con 0x7f79e407ef90 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f79d8001420 con 0x7f79e407ef90 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1044583846 0 0) 0x7f79e407f7f0 con 0x7f79e409bca0 2020-01-26T15:27:20.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79c4003230 con 0x7f79e409bca0 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f79dc001910 con 0x7f79e409bca0 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2294864836 0 0) 0x7f79e409a850 con 0x7f79e407f3c0 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f79e407f7f0 con 0x7f79e407f3c0 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f79d4001510 con 0x7f79e407f3c0 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6791/0 conn(0x7f79e407ef90 legacy=0x7f79e41362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6790/0 conn(0x7f79e409bca0 legacy=0x7f79e409cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6789/0 conn(0x7f79e407f3c0 legacy=0x7f79e4139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f79e409c0d0 con 0x7f79c4003540 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f79e409a850 con 0x7f79c4008750 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4010d50 con 0x7f79c400c3a0 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6791/0 conn(0x7f79c4008750 legacy=0x7f79c400ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505790532 0 0) 0x7f79e409a850 con 0x7f79c4008750 2020-01-26T15:27:20.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6790/0 conn(0x7f79c4003540 legacy=0x7f79c4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f79e409b870 con 0x7f79c400c3a0 2020-01-26T15:27:20.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e409fa90 con 0x7f79c400c3a0 2020-01-26T15:27:20.762 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e409bca0 con 0x7f79c400c3a0 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f79d400c7d0 con 0x7f79c400c3a0 2020-01-26T15:27:20.763 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d400c9d0 con 0x7f79c400c3a0 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0003360 con 0x7f79c400c3a0 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f79d400cbc0 con 0x7f79c400c3a0 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.754+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f79d404cf50 con 0x7f79c400c3a0 2020-01-26T15:27:20.764 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.758+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.758+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f79d4033100 con 0x7f79c400c3a0 2020-01-26T15:27:20.913 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.914+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f79c0003790 con 0x7f79c400c3a0 2020-01-26T15:27:20.913 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.914+0000 7f79eb439700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:20.914 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.914+0000 7f79e27fc700 1 -- 172.21.15.129:0/3222153079 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f79d4033360 con 0x7f79c400c3a0 2020-01-26T15:27:20.914 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:20.916 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 >> v1:172.21.15.129:6800/16899 conn(0x7f79c40488d0 legacy=0x7f79c404ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 msgr2=0x7f79c400e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 --2- 172.21.15.129:0/3222153079 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f79c400c3a0 0x7f79c400e7e0 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f79dc001250 tx=0x7f79d8001dd0).stop 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79eb439700 1 -- 172.21.15.129:0/3222153079 reap_dead start 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 shutdown_connections 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 >> 172.21.15.129:0/3222153079 conn(0x7f79e4097e00 msgr2=0x7f79e40a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 shutdown_connections 2020-01-26T15:27:20.917 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:20.918+0000 7f79ea1d7700 1 -- 172.21.15.129:0/3222153079 wait complete. 2020-01-26T15:27:20.933 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:23.934 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:24.050 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.046+0000 7f378d5f7700 1 Processor -- start 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.046+0000 7f378d5f7700 1 -- start start 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 0x7f378805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3788098000 con 0x7f3788149040 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378805e050 con 0x7f37880a6870 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f37880a6ca0 con 0x7f378805edd0 2020-01-26T15:27:24.051 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378cdf6700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 0x7f378805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f3787fff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f37880a6870 0x7f378807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47024/0 (socket says 172.21.15.129:47024) 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f3787fff700 1 -- 172.21.15.129:0/795139365 learned_addr learned my addr 172.21.15.129:0/795139365 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378cdf6700 1 --2- 172.21.15.129:0/795139365 >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 0x7f378805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540153603 0 0) 0x7f378805e050 con 0x7f37880a6870 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3774003230 con 0x7f37880a6870 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630100752 0 0) 0x7f3788098000 con 0x7f3788149040 2020-01-26T15:27:24.052 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f378805e050 con 0x7f3788149040 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3095471437 0 0) 0x7f3774003230 con 0x7f37880a6870 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 msgr2=0x7f378805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 --2- 172.21.15.129:0/795139365 >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 0x7f378805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 >> v1:172.21.15.129:6789/0 conn(0x7f3788149040 legacy=0x7f378814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378814ecb0 con 0x7f37880a6870 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3770001710 con 0x7f37880a6870 2020-01-26T15:27:24.053 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f37700019e0 con 0x7f37880a6870 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f37877fe700 1 -- 172.21.15.129:0/795139365 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f37700045b0 con 0x7f37880a6870 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- 172.21.15.129:0/795139365 >> v1:172.21.15.129:6791/0 conn(0x7f37880a6870 legacy=0x7f378807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- 172.21.15.129:0/795139365 shutdown_connections 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 --2- 172.21.15.129:0/795139365 >> v2:172.21.15.129:6791/0 conn(0x7f378805edd0 0x7f378805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- 172.21.15.129:0/795139365 >> 172.21.15.129:0/795139365 conn(0x7f3788098e70 msgr2=0x7f37880a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- 172.21.15.129:0/795139365 shutdown_connections 2020-01-26T15:27:24.054 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.050+0000 7f378d5f7700 1 -- 172.21.15.129:0/795139365 wait complete. 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 Processor -- start 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 -- start start 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 0x7f37881338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3788133e20 con 0x7f378811e570 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378811edd0 con 0x7f378807c9e0 2020-01-26T15:27:24.058 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378d5f7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3788024f20 con 0x7f378811e9a0 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378e859700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f378807c9e0 0x7f378807ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47032/0 (socket says 172.21.15.129:47032) 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f378e859700 1 -- 172.21.15.129:0/1174989660 learned_addr learned my addr 172.21.15.129:0/1174989660 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f3787fff700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 0x7f37881338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f3787fff700 1 --2- 172.21.15.129:0/1174989660 >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 0x7f37881338d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385438382 0 0) 0x7f378811edd0 con 0x7f378807c9e0 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f376c003230 con 0x7f378807c9e0 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764372086 0 0) 0x7f3788133e20 con 0x7f378811e570 2020-01-26T15:27:24.059 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f378811edd0 con 0x7f378811e570 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3136431982 0 0) 0x7f376c003230 con 0x7f378807c9e0 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3788133e20 con 0x7f378807c9e0 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.054+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3778001dd0 con 0x7f378807c9e0 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1061966491 0 0) 0x7f378811edd0 con 0x7f378811e570 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f376c003230 con 0x7f378811e570 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f37800016a0 con 0x7f378811e570 2020-01-26T15:27:24.060 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2632598055 0 0) 0x7f3788133e20 con 0x7f378807c9e0 2020-01-26T15:27:24.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 msgr2=0x7f37881338d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:24.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 --2- 172.21.15.129:0/1174989660 >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 0x7f37881338d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:24.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 >> v1:172.21.15.129:6790/0 conn(0x7f378811e570 legacy=0x7f37881330d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:24.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788024af0 con 0x7f378807c9e0 2020-01-26T15:27:24.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378807d610 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f378813b760 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3778002280 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3778002620 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f3778002820 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3788056600 con 0x7f378807c9e0 2020-01-26T15:27:24.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.058+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f377804bbf0 con 0x7f378807c9e0 2020-01-26T15:27:24.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.062+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f3778002bb0 con 0x7f378807c9e0 2020-01-26T15:27:24.216 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f378805cc60 con 0x7f378807c9e0 2020-01-26T15:27:24.216 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f37857fa700 1 -- 172.21.15.129:0/1174989660 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f37780310b0 con 0x7f378807c9e0 2020-01-26T15:27:24.216 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 >> v1:172.21.15.129:6800/16899 conn(0x7f376c03e530 legacy=0x7f376c040a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 >> v1:172.21.15.129:6791/0 conn(0x7f378807c9e0 legacy=0x7f378807ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 shutdown_connections 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 --2- 172.21.15.129:0/1174989660 >> v2:172.21.15.129:6790/0 conn(0x7f378811e9a0 0x7f37881338d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 >> 172.21.15.129:0/1174989660 conn(0x7f37880a5520 msgr2=0x7f378809de10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:24.218 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 shutdown_connections 2020-01-26T15:27:24.219 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:24.218+0000 7f378d5f7700 1 -- 172.21.15.129:0/1174989660 wait complete. 2020-01-26T15:27:24.229 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:27.230 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 Processor -- start 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 -- start start 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80a43f0 con 0x7fafe80a4af0 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80a4f20 con 0x7fafe8080440 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80a0b50 con 0x7fafe80a32d0 2020-01-26T15:27:27.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe6ffd700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fafe80a32d0 0x7fafe805f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47040/0 (socket says 172.21.15.129:47040) 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe6ffd700 1 -- 172.21.15.129:0/2760003641 learned_addr learned my addr 172.21.15.129:0/2760003641 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe77fe700 1 --1- 172.21.15.129:0/2760003641 >> v1:172.21.15.129:6790/0 conn(0x7fafe8080440 0x7fafe805eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49420/0 (socket says 172.21.15.129:49420) 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565315702 0 0) 0x7fafe80a0b50 con 0x7fafe80a32d0 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0003230 con 0x7fafe80a32d0 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520750443 0 0) 0x7fafe0001450 con 0x7fafe8080440 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe80a0b50 con 0x7fafe8080440 2020-01-26T15:27:27.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47676841 0 0) 0x7fafe80a43f0 con 0x7fafe80a4af0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe0001450 con 0x7fafe80a4af0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4034323018 0 0) 0x7fafd0003230 con 0x7fafe80a32d0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 >> v1:172.21.15.129:6790/0 conn(0x7fafe8080440 legacy=0x7fafe805eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 >> v1:172.21.15.129:6789/0 conn(0x7fafe80a4af0 legacy=0x7fafe814cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe805b180 con 0x7fafe80a32d0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fafdc001710 con 0x7fafe80a32d0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafe67fc700 1 -- 172.21.15.129:0/2760003641 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fafdc0019e0 con 0x7fafe80a32d0 2020-01-26T15:27:27.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.346+0000 7fafed49e700 1 -- 172.21.15.129:0/2760003641 >> v1:172.21.15.129:6791/0 conn(0x7fafe80a32d0 legacy=0x7fafe805f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- 172.21.15.129:0/2760003641 shutdown_connections 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- 172.21.15.129:0/2760003641 >> 172.21.15.129:0/2760003641 conn(0x7fafe8098160 msgr2=0x7fafe805e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- 172.21.15.129:0/2760003641 shutdown_connections 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- 172.21.15.129:0/2760003641 wait complete. 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 Processor -- start 2020-01-26T15:27:27.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- start start 2020-01-26T15:27:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fafe8159620 0x7fafe815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe8094740 con 0x7fafe8094310 2020-01-26T15:27:27.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe8065be0 con 0x7fafe80950e0 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafed49e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80914f0 con 0x7fafe8159620 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafe77fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fafe80950e0 0x7fafe8092080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49426/0 (socket says 172.21.15.129:49426) 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafe77fe700 1 -- 172.21.15.129:0/1945747275 learned_addr learned my addr 172.21.15.129:0/1945747275 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafe6ffd700 1 --1- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6789/0 conn(0x7fafe8094310 0x7fafe807eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41130/0 (socket says 172.21.15.129:41130) 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafe7fff700 -1 --2- 172.21.15.129:0/1945747275 >> v2:172.21.15.129:6790/0 conn(0x7fafe8159620 0x7fafe815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> v2:172.21.15.129:6790/0 conn(0x7fafe8159620 0x7fafe815ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:27.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902335941 0 0) 0x7fafe8094740 con 0x7fafe8094310 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc8003230 con 0x7fafe8094310 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425652814 0 0) 0x7fafe8065be0 con 0x7fafe80950e0 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.350+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe8094740 con 0x7fafe80950e0 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3807700657 0 0) 0x7fafe8094740 con 0x7fafe80950e0 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafe8065be0 con 0x7fafe80950e0 2020-01-26T15:27:27.359 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fafe0001f40 con 0x7fafe80950e0 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3636681908 0 0) 0x7fafc8003230 con 0x7fafe8094310 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafe8094740 con 0x7fafe8094310 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fafdc004880 con 0x7fafe8094310 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 >> v2:172.21.15.129:6790/0 conn(0x7fafe8159620 msgr2=0x7fafe815ba60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 --2- 172.21.15.129:0/1945747275 >> v2:172.21.15.129:6790/0 conn(0x7fafe8159620 0x7fafe815ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6790/0 conn(0x7fafe80950e0 legacy=0x7fafe8092080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.360 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6789/0 conn(0x7fafe8094310 legacy=0x7fafe807eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:27.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fafc8003230 con 0x7fafc8003d40 2020-01-26T15:27:27.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fafc8004210 con 0x7fafc8004f20 2020-01-26T15:27:27.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80914f0 con 0x7fafc800c000 2020-01-26T15:27:27.361 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853391223 0 0) 0x7fafc8004210 con 0x7fafc8004f20 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc800e990 con 0x7fafc8004f20 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623551923 0 0) 0x7fafc8003230 con 0x7fafc8003d40 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 -- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6791/0 conn(0x7fafc8004f20 legacy=0x7fafc8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 -- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6790/0 conn(0x7fafc8003d40 legacy=0x7fafc800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fafe80991a0 con 0x7fafc800c000 2020-01-26T15:27:27.362 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe8095d50 con 0x7fafc800c000 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe807f2c0 con 0x7fafc800c000 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fafd8006840 con 0x7fafc800c000 2020-01-26T15:27:27.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8006a40 con 0x7fafc800c000 2020-01-26T15:27:27.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0003360 con 0x7fafc800c000 2020-01-26T15:27:27.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fafd8006c30 con 0x7fafc800c000 2020-01-26T15:27:27.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.354+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fafd804c970 con 0x7fafc800c000 2020-01-26T15:27:27.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.362+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.362+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fafd8032b20 con 0x7fafc800c000 2020-01-26T15:27:27.514 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.514+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fafc0003790 con 0x7fafc800c000 2020-01-26T15:27:27.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.514+0000 7fafe7fff700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:27.515 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafcffff700 1 -- 172.21.15.129:0/1945747275 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fafd8032d80 con 0x7fafc800c000 2020-01-26T15:27:27.515 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:27.516 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 >> v1:172.21.15.129:6800/16899 conn(0x7fafc80486c0 legacy=0x7fafc804abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafe7fff700 1 -- 172.21.15.129:0/1945747275 reap_dead start 2020-01-26T15:27:27.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 msgr2=0x7fafc800e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:27.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fafd80011d0 tx=0x7fafd8010a10).stop 2020-01-26T15:27:27.517 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 shutdown_connections 2020-01-26T15:27:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 --2- 172.21.15.129:0/1945747275 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fafc800c000 0x7fafc800e440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 >> 172.21.15.129:0/1945747275 conn(0x7fafe805e320 msgr2=0x7fafe8062230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 shutdown_connections 2020-01-26T15:27:27.518 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:27.518+0000 7fafed49e700 1 -- 172.21.15.129:0/1945747275 wait complete. 2020-01-26T15:27:27.528 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:30.529 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:30.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 Processor -- start 2020-01-26T15:27:30.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 -- start start 2020-01-26T15:27:30.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 0x7fdf5c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c0a5b80 con 0x7fdf5c0a5750 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c080440 con 0x7fdf5c1495c0 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c0a43f0 con 0x7fdf5c146c30 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf62084700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fdf5c1495c0 0x7fdf5c14ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49444/0 (socket says 172.21.15.129:49444) 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf62084700 1 -- 172.21.15.129:0/1080723696 learned_addr learned my addr 172.21.15.129:0/1080723696 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:30.654 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf61082700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 0x7fdf5c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf61082700 1 --2- 172.21.15.129:0/1080723696 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 0x7fdf5c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf61883700 1 --1- 172.21.15.129:0/1080723696 >> v1:172.21.15.129:6789/0 conn(0x7fdf5c0a5750 0x7fdf5c0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41140/0 (socket says 172.21.15.129:41140) 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378419146 0 0) 0x7fdf5c080440 con 0x7fdf5c1495c0 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf44003230 con 0x7fdf5c1495c0 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408703740 0 0) 0x7fdf5c0a5b80 con 0x7fdf5c0a5750 2020-01-26T15:27:30.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5c080440 con 0x7fdf5c0a5750 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4211330799 0 0) 0x7fdf44003230 con 0x7fdf5c1495c0 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 msgr2=0x7fdf5c149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 --2- 172.21.15.129:0/1080723696 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 0x7fdf5c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 >> v1:172.21.15.129:6789/0 conn(0x7fdf5c0a5750 legacy=0x7fdf5c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0a4e00 con 0x7fdf5c1495c0 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdf54001710 con 0x7fdf5c1495c0 2020-01-26T15:27:30.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdf540019e0 con 0x7fdf5c1495c0 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf632e6700 1 -- 172.21.15.129:0/1080723696 >> v1:172.21.15.129:6790/0 conn(0x7fdf5c1495c0 legacy=0x7fdf5c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.650+0000 7fdf60881700 1 -- 172.21.15.129:0/1080723696 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdf540045b0 con 0x7fdf5c1495c0 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 -- 172.21.15.129:0/1080723696 shutdown_connections 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 --2- 172.21.15.129:0/1080723696 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c146c30 0x7fdf5c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 -- 172.21.15.129:0/1080723696 >> 172.21.15.129:0/1080723696 conn(0x7fdf5c05e050 msgr2=0x7fdf5c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 -- 172.21.15.129:0/1080723696 shutdown_connections 2020-01-26T15:27:30.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 -- 172.21.15.129:0/1080723696 wait complete. 2020-01-26T15:27:30.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 Processor -- start 2020-01-26T15:27:30.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.654+0000 7fdf632e6700 1 -- start start 2020-01-26T15:27:30.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdf5c062760 0x7fdf5c060560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c0661c0 con 0x7fdf5c096690 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5c0a7180 con 0x7fdf5c062e00 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5c061dc0 con 0x7fdf5c062760 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf61883700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdf5c062760 0x7fdf5c060560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf61883700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fdf5c062760 0x7fdf5c060560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf61082700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdf5c062e00 0x7fdf5c095e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47064/0 (socket says 172.21.15.129:47064) 2020-01-26T15:27:30.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdf5c096690 0x7fdf5c1384a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41150/0 (socket says 172.21.15.129:41150) 2020-01-26T15:27:30.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf61082700 1 -- 172.21.15.129:0/2069817585 learned_addr learned my addr 172.21.15.129:0/2069817585 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:30.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639035038 0 0) 0x7fdf5c0a7180 con 0x7fdf5c062e00 2020-01-26T15:27:30.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf3c003230 con 0x7fdf5c062e00 2020-01-26T15:27:30.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136565421 0 0) 0x7fdf5c0661c0 con 0x7fdf5c096690 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5c0a7180 con 0x7fdf5c096690 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2692053987 0 0) 0x7fdf3c003230 con 0x7fdf5c062e00 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf5c0661c0 con 0x7fdf5c062e00 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdf50002740 con 0x7fdf5c062e00 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3318442049 0 0) 0x7fdf5c0a7180 con 0x7fdf5c096690 2020-01-26T15:27:30.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf3c003230 con 0x7fdf5c096690 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdf54001420 con 0x7fdf5c096690 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c062760 msgr2=0x7fdf5c060560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 --2- 172.21.15.129:0/2069817585 >> v2:172.21.15.129:6790/0 conn(0x7fdf5c062760 0x7fdf5c060560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 >> v1:172.21.15.129:6791/0 conn(0x7fdf5c062e00 legacy=0x7fdf5c095e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 >> v1:172.21.15.129:6789/0 conn(0x7fdf5c096690 legacy=0x7fdf5c1384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.666 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdf5c0661c0 con 0x7fdf3c004da0 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdf5c0a7180 con 0x7fdf3c003ec0 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5c061dc0 con 0x7fdf3c00c000 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638704028 0 0) 0x7fdf5c0661c0 con 0x7fdf3c004da0 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 -- 172.21.15.129:0/2069817585 >> v1:172.21.15.129:6791/0 conn(0x7fdf3c003ec0 legacy=0x7fdf3c0045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.667 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 -- 172.21.15.129:0/2069817585 >> v1:172.21.15.129:6790/0 conn(0x7fdf3c004da0 legacy=0x7fdf3c00a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fdf5c063230 con 0x7fdf3c00c000 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5c11f1d0 con 0x7fdf3c00c000 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5c096ac0 con 0x7fdf3c00c000 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.658+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:30.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fdf54001210 con 0x7fdf3c00c000 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54004800 con 0x7fdf3c00c000 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf38003360 con 0x7fdf3c00c000 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fdf540049f0 con 0x7fdf3c00c000 2020-01-26T15:27:30.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.662+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fdf5404d420 con 0x7fdf3c00c000 2020-01-26T15:27:30.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.666+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.666+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fdf54033830 con 0x7fdf3c00c000 2020-01-26T15:27:30.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdf38003790 con 0x7fdf3c00c000 2020-01-26T15:27:30.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf62084700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:30.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf5a7fc700 1 -- 172.21.15.129:0/2069817585 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fdf54004d00 con 0x7fdf3c00c000 2020-01-26T15:27:30.825 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:30.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 >> v1:172.21.15.129:6800/16899 conn(0x7fdf3c0481e0 legacy=0x7fdf3c04a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 msgr2=0x7fdf3c00e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:30.826 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf62084700 1 -- 172.21.15.129:0/2069817585 reap_dead start 2020-01-26T15:27:30.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fdf540010b0 tx=0x7fdf54011450).stop 2020-01-26T15:27:30.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 shutdown_connections 2020-01-26T15:27:30.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 --2- 172.21.15.129:0/2069817585 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdf3c00c000 0x7fdf3c00e440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:30.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 >> 172.21.15.129:0/2069817585 conn(0x7fdf5c05f4e0 msgr2=0x7fdf5c07f520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:30.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 shutdown_connections 2020-01-26T15:27:30.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:30.826+0000 7fdf632e6700 1 -- 172.21.15.129:0/2069817585 wait complete. 2020-01-26T15:27:30.837 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:33.839 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:33.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 Processor -- start 2020-01-26T15:27:33.961 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 -- start start 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 0x7f156414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156405ea20 con 0x7f156405e5f0 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1564098000 con 0x7f156405edd0 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f156405e050 con 0x7f15640a6870 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f1568872700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 0x7f156414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f1562d9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f156405edd0 0x7f156407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49460/0 (socket says 172.21.15.129:49460) 2020-01-26T15:27:33.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f1568872700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 0x7f156414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f1562d9d700 1 -- 172.21.15.129:0/1459142104 learned_addr learned my addr 172.21.15.129:0/1459142104 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.958+0000 7f156259c700 1 --1- 172.21.15.129:0/1459142104 >> v1:172.21.15.129:6789/0 conn(0x7f156405e5f0 0x7f1564149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41162/0 (socket says 172.21.15.129:41162) 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601384381 0 0) 0x7f1564098000 con 0x7f156405edd0 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f154c003230 con 0x7f156405edd0 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031704423 0 0) 0x7f156405ea20 con 0x7f156405e5f0 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1564098000 con 0x7f156405e5f0 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1515453267 0 0) 0x7f154c003230 con 0x7f156405edd0 2020-01-26T15:27:33.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 msgr2=0x7f156414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 --2- 172.21.15.129:0/1459142104 >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 0x7f156414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 >> v1:172.21.15.129:6789/0 conn(0x7f156405e5f0 legacy=0x7f1564149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640a6ca0 con 0x7f156405edd0 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1554001710 con 0x7f156405edd0 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15540019e0 con 0x7f156405edd0 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f1561d9b700 1 -- 172.21.15.129:0/1459142104 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15540045b0 con 0x7f156405edd0 2020-01-26T15:27:33.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 -- 172.21.15.129:0/1459142104 >> v1:172.21.15.129:6790/0 conn(0x7f156405edd0 legacy=0x7f156407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:33.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 -- 172.21.15.129:0/1459142104 shutdown_connections 2020-01-26T15:27:33.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 --2- 172.21.15.129:0/1459142104 >> v2:172.21.15.129:6790/0 conn(0x7f15640a6870 0x7f156414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:33.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 -- 172.21.15.129:0/1459142104 >> 172.21.15.129:0/1459142104 conn(0x7f1564098e70 msgr2=0x7f15640a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:33.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 -- 172.21.15.129:0/1459142104 shutdown_connections 2020-01-26T15:27:33.965 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.962+0000 7f156359e700 1 -- 172.21.15.129:0/1459142104 wait complete. 2020-01-26T15:27:33.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 Processor -- start 2020-01-26T15:27:33.968 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- start start 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 0x7f156409da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 0x7f1564130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156409e820 con 0x7f156407aa60 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f156409df90 con 0x7f156407ae90 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f156409b3c0 con 0x7f156409b680 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f1562d9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 0x7f156409da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:33.969 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f1568872700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 0x7f1564130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156259c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f156407aa60 0x7f1564130450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49468/0 (socket says 172.21.15.129:49468) 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f1568872700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 0x7f1564130c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156259c700 1 -- 172.21.15.129:0/2908643587 learned_addr learned my addr 172.21.15.129:0/2908643587 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f1562d9d700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 0x7f156409da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262188393 0 0) 0x7f156409e820 con 0x7f156407aa60 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1548003230 con 0x7f156407aa60 2020-01-26T15:27:33.970 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3897828578 0 0) 0x7f1548003230 con 0x7f156407aa60 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f156409e820 con 0x7f156407aa60 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15580018f0 con 0x7f156407aa60 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3453871447 0 0) 0x7f156409e820 con 0x7f156407aa60 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 msgr2=0x7f156409da40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 0x7f156409da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 msgr2=0x7f1564130c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:33.971 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 0x7f1564130c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156407f520 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156405c200 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f156409e4d0 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1558001cd0 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1558004a50 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.966+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f1558004c50 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.970+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1564056600 con 0x7f156407aa60 2020-01-26T15:27:33.972 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.970+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f155804b9d0 con 0x7f156407aa60 2020-01-26T15:27:33.973 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:33.970+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1558030ef0 con 0x7f156407aa60 2020-01-26T15:27:34.127 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.126+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f156407b9a0 con 0x7f156407aa60 2020-01-26T15:27:34.127 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f15537fe700 1 -- 172.21.15.129:0/2908643587 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f155804a5e0 con 0x7f156407aa60 2020-01-26T15:27:34.127 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:34.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 >> v1:172.21.15.129:6800/16899 conn(0x7f15480403d0 legacy=0x7f15480428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:34.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 >> v1:172.21.15.129:6790/0 conn(0x7f156407aa60 legacy=0x7f1564130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:34.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 shutdown_connections 2020-01-26T15:27:34.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6790/0 conn(0x7f156407ae90 0x7f1564130c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:34.129 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 --2- 172.21.15.129:0/2908643587 >> v2:172.21.15.129:6791/0 conn(0x7f156409b680 0x7f156409da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:34.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 >> 172.21.15.129:0/2908643587 conn(0x7f156405edd0 msgr2=0x7f15640a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:34.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 shutdown_connections 2020-01-26T15:27:34.130 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:34.130+0000 7f156359e700 1 -- 172.21.15.129:0/2908643587 wait complete. 2020-01-26T15:27:34.144 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:37.145 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:37.265 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 Processor -- start 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 -- start start 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 0x7f9a1014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1005ea20 con 0x7f9a1005e5f0 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10098000 con 0x7f9a1005edd0 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0f59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1005e050 con 0x7f9a100a6870 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0e59c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9a1005e5f0 0x7f9a10149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41176/0 (socket says 172.21.15.129:41176) 2020-01-26T15:27:37.266 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0e59c700 1 -- 172.21.15.129:0/1931346749 learned_addr learned my addr 172.21.15.129:0/1931346749 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a0ed9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f9a1005edd0 0x7f9a1007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47090/0 (socket says 172.21.15.129:47090) 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a14c90700 -1 --2- 172.21.15.129:0/1931346749 >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 0x7f9a1014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.262+0000 7f9a14c90700 1 --2- 172.21.15.129:0/1931346749 >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 0x7f9a1014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657096822 0 0) 0x7f9a10098000 con 0x7f9a1005edd0 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99fc003230 con 0x7f9a1005edd0 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686603269 0 0) 0x7f9a1005ea20 con 0x7f9a1005e5f0 2020-01-26T15:27:37.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10098000 con 0x7f9a1005e5f0 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1990759902 0 0) 0x7f99fc003230 con 0x7f9a1005edd0 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 msgr2=0x7f9a1014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 --2- 172.21.15.129:0/1931346749 >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 0x7f9a1014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 >> v1:172.21.15.129:6789/0 conn(0x7f9a1005e5f0 legacy=0x7f9a10149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100a6ca0 con 0x7f9a1005edd0 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9a00001710 con 0x7f9a1005edd0 2020-01-26T15:27:37.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a000019e0 con 0x7f9a1005edd0 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0dd9b700 1 -- 172.21.15.129:0/1931346749 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9a000044f0 con 0x7f9a1005edd0 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 -- 172.21.15.129:0/1931346749 >> v1:172.21.15.129:6791/0 conn(0x7f9a1005edd0 legacy=0x7f9a1007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 -- 172.21.15.129:0/1931346749 shutdown_connections 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 --2- 172.21.15.129:0/1931346749 >> v2:172.21.15.129:6790/0 conn(0x7f9a100a6870 0x7f9a1014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 -- 172.21.15.129:0/1931346749 >> 172.21.15.129:0/1931346749 conn(0x7f9a10098e70 msgr2=0x7f9a100a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 -- 172.21.15.129:0/1931346749 shutdown_connections 2020-01-26T15:27:37.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.266+0000 7f9a0f59e700 1 -- 172.21.15.129:0/1931346749 wait complete. 2020-01-26T15:27:37.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 Processor -- start 2020-01-26T15:27:37.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 -- start start 2020-01-26T15:27:37.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1009e7d0 con 0x7f9a1009e3a0 2020-01-26T15:27:37.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100a1050 con 0x7f9a1009de90 2020-01-26T15:27:37.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10099bc0 con 0x7f9a1009fc50 2020-01-26T15:27:37.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0e59c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f9a1009fc50 0x7f9a1007d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47098/0 (socket says 172.21.15.129:47098) 2020-01-26T15:27:37.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0ed9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f9a1009de90 0x7f9a1007c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49480/0 (socket says 172.21.15.129:49480) 2020-01-26T15:27:37.273 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0ed9d700 1 -- 172.21.15.129:0/2752341748 learned_addr learned my addr 172.21.15.129:0/2752341748 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684362415 0 0) 0x7f9a100a1050 con 0x7f9a1009de90 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003230 con 0x7f9a1009de90 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020993850 0 0) 0x7f9a10099bc0 con 0x7f9a1009fc50 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a100a1050 con 0x7f9a1009fc50 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063693447 0 0) 0x7f9a1009e7d0 con 0x7f9a1009e3a0 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10099bc0 con 0x7f9a1009e3a0 2020-01-26T15:27:37.274 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2271466148 0 0) 0x7f99f4003230 con 0x7f9a1009de90 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a1009e7d0 con 0x7f9a1009de90 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9a000015d0 con 0x7f9a1009de90 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 846592640 0 0) 0x7f9a100a1050 con 0x7f9a1009fc50 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99f4003230 con 0x7f9a1009fc50 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f99f80017d0 con 0x7f9a1009fc50 2020-01-26T15:27:37.275 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1892746027 0 0) 0x7f9a10099bc0 con 0x7f9a1009e3a0 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a100a1050 con 0x7f9a1009e3a0 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2572932591 0 0) 0x7f9a1009e7d0 con 0x7f9a1009de90 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 >> v1:172.21.15.129:6791/0 conn(0x7f9a1009fc50 legacy=0x7f9a1007d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 >> v1:172.21.15.129:6789/0 conn(0x7f9a1009e3a0 legacy=0x7f9a10138950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1013d190 con 0x7f9a1009de90 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.270+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1013a160 con 0x7f9a1009de90 2020-01-26T15:27:37.276 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a000048a0 con 0x7f9a1009de90 2020-01-26T15:27:37.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1013a630 con 0x7f9a1009de90 2020-01-26T15:27:37.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9a00004c40 con 0x7f9a1009de90 2020-01-26T15:27:37.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f9a00005ef0 con 0x7f9a1009de90 2020-01-26T15:27:37.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f9a0004b910 con 0x7f9a1009de90 2020-01-26T15:27:37.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.274+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8003360 con 0x7f9a1009de90 2020-01-26T15:27:37.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.278+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f9a00030c90 con 0x7f9a1009de90 2020-01-26T15:27:37.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f99e80037d0 con 0x7f9a1009de90 2020-01-26T15:27:37.433 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a077fe700 1 -- 172.21.15.129:0/2752341748 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f9a00030ef0 con 0x7f9a1009de90 2020-01-26T15:27:37.434 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:37.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 >> v1:172.21.15.129:6800/16899 conn(0x7f99f403e950 legacy=0x7f99f4040e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.434 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 >> v1:172.21.15.129:6790/0 conn(0x7f9a1009de90 legacy=0x7f9a1007c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:37.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 shutdown_connections 2020-01-26T15:27:37.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.434+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 >> 172.21.15.129:0/2752341748 conn(0x7f9a100a1fc0 msgr2=0x7f9a101227a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:37.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.438+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 shutdown_connections 2020-01-26T15:27:37.435 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:37.438+0000 7f9a0f59e700 1 -- 172.21.15.129:0/2752341748 wait complete. 2020-01-26T15:27:37.446 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:40.447 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:40.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 Processor -- start 2020-01-26T15:27:40.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 -- start start 2020-01-26T15:27:40.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 0x7f03a80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:40.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80a5b80 con 0x7f03a805f250 2020-01-26T15:27:40.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a8080440 con 0x7f03a80a4b50 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80a43f0 con 0x7f03a80a5750 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03adb56700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f03a80a4b50 0x7f03a805ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47104/0 (socket says 172.21.15.129:47104) 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03adb56700 1 -- 172.21.15.129:0/3049728313 learned_addr learned my addr 172.21.15.129:0/3049728313 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ae357700 -1 --2- 172.21.15.129:0/3049728313 >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 0x7f03a80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ae357700 1 --2- 172.21.15.129:0/3049728313 >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 0x7f03a80a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829453229 0 0) 0x7f03a8080440 con 0x7f03a80a4b50 2020-01-26T15:27:40.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0394003230 con 0x7f03a80a4b50 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534048372 0 0) 0x7f03a80a5b80 con 0x7f03a805f250 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a8080440 con 0x7f03a805f250 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4161862198 0 0) 0x7f03a8080440 con 0x7f03a805f250 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 msgr2=0x7f03a80a4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 --2- 172.21.15.129:0/3049728313 >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 0x7f03a80a4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:40.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 >> v1:172.21.15.129:6791/0 conn(0x7f03a80a4b50 legacy=0x7f03a805ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80a3210 con 0x7f03a805f250 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f03900016f0 con 0x7f03a805f250 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03900019c0 con 0x7f03a805f250 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03afdba700 1 -- 172.21.15.129:0/3049728313 >> v1:172.21.15.129:6790/0 conn(0x7f03a805f250 legacy=0x7f03a814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.566+0000 7f03ad355700 1 -- 172.21.15.129:0/3049728313 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0390001e20 con 0x7f03a805f250 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- 172.21.15.129:0/3049728313 shutdown_connections 2020-01-26T15:27:40.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 --2- 172.21.15.129:0/3049728313 >> v2:172.21.15.129:6790/0 conn(0x7f03a80a5750 0x7f03a80a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- 172.21.15.129:0/3049728313 >> 172.21.15.129:0/3049728313 conn(0x7f03a805e050 msgr2=0x7f03a8098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- 172.21.15.129:0/3049728313 shutdown_connections 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- 172.21.15.129:0/3049728313 wait complete. 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 Processor -- start 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- start start 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 0x7f03a8079de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:40.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 0x7f03a8138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a8123c40 con 0x7f03a8123640 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f03a811d8a0 con 0x7f03a807a330 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03afdba700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f03a8121180 con 0x7f03a8122470 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03ae357700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f03a8123640 0x7f03a8121780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47110/0 (socket says 172.21.15.129:47110) 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03aeb58700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 0x7f03a8138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03ae357700 1 -- 172.21.15.129:0/2662926111 learned_addr learned my addr 172.21.15.129:0/2662926111 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:40.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03adb56700 -1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 0x7f03a8079de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03aeb58700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 0x7f03a8138480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03adb56700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 0x7f03a8079de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.570+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967397793 0 0) 0x7f03a8123c40 con 0x7f03a8123640 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c003230 con 0x7f03a8123640 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3556413938 0 0) 0x7f038c003230 con 0x7f03a8123640 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03a8123c40 con 0x7f03a8123640 2020-01-26T15:27:40.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f03a0002b20 con 0x7f03a8123640 2020-01-26T15:27:40.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2879413012 0 0) 0x7f03a8123c40 con 0x7f03a8123640 2020-01-26T15:27:40.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 msgr2=0x7f03a8079de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:40.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 0x7f03a8079de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:40.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 msgr2=0x7f03a8138480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:40.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 0x7f03a8138480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:40.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a81228a0 con 0x7f03a8123640 2020-01-26T15:27:40.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a811ed60 con 0x7f03a8123640 2020-01-26T15:27:40.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f03a0001310 con 0x7f03a8123640 2020-01-26T15:27:40.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f03a00016f0 con 0x7f03a8123640 2020-01-26T15:27:40.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a807a900 con 0x7f03a8123640 2020-01-26T15:27:40.582 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f03a00018f0 con 0x7f03a8123640 2020-01-26T15:27:40.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f03a004bf60 con 0x7f03a8123640 2020-01-26T15:27:40.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.574+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8056600 con 0x7f03a8123640 2020-01-26T15:27:40.583 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.578+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f03a0031480 con 0x7f03a8123640 2020-01-26T15:27:40.733 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.734+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03a805cc60 con 0x7f03a8123640 2020-01-26T15:27:40.734 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.734+0000 7f03a6ffd700 1 -- 172.21.15.129:0/2662926111 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f03a004abd0 con 0x7f03a8123640 2020-01-26T15:27:40.734 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:40.735 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 >> v1:172.21.15.129:6800/16899 conn(0x7f038c03e0a0 legacy=0x7f038c0405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 >> v1:172.21.15.129:6791/0 conn(0x7f03a8123640 legacy=0x7f03a8121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 shutdown_connections 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6790/0 conn(0x7f03a807a330 0x7f03a8138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 --2- 172.21.15.129:0/2662926111 >> v2:172.21.15.129:6791/0 conn(0x7f03a8122470 0x7f03a8079de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 >> 172.21.15.129:0/2662926111 conn(0x7f03a80a6260 msgr2=0x7f03a80a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:40.736 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 shutdown_connections 2020-01-26T15:27:40.737 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:40.738+0000 7f03afdba700 1 -- 172.21.15.129:0/2662926111 wait complete. 2020-01-26T15:27:40.748 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:43.748 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 Processor -- start 2020-01-26T15:27:43.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 -- start start 2020-01-26T15:27:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 0x7fcb9414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9405ea20 con 0x7fcb9405edd0 2020-01-26T15:27:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb94098000 con 0x7fcb9405e5f0 2020-01-26T15:27:43.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb93fff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9405e050 con 0x7fcb940a6870 2020-01-26T15:27:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb99718700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 0x7fcb9414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb8bfff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fcb9405e5f0 0x7fcb94149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47122/0 (socket says 172.21.15.129:47122) 2020-01-26T15:27:43.882 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb937fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fcb9405edd0 0x7fcb9407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49504/0 (socket says 172.21.15.129:49504) 2020-01-26T15:27:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb8bfff700 1 -- 172.21.15.129:0/984688403 learned_addr learned my addr 172.21.15.129:0/984688403 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb99718700 1 --2- 172.21.15.129:0/984688403 >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 0x7fcb9414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838735740 0 0) 0x7fcb94098000 con 0x7fcb9405e5f0 2020-01-26T15:27:43.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.870+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb80003230 con 0x7fcb9405e5f0 2020-01-26T15:27:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305730722 0 0) 0x7fcb9405ea20 con 0x7fcb9405edd0 2020-01-26T15:27:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94098000 con 0x7fcb9405edd0 2020-01-26T15:27:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3980137480 0 0) 0x7fcb94098000 con 0x7fcb9405edd0 2020-01-26T15:27:43.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 msgr2=0x7fcb9414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 --2- 172.21.15.129:0/984688403 >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 0x7fcb9414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 >> v1:172.21.15.129:6791/0 conn(0x7fcb9405e5f0 legacy=0x7fcb94149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940a6ca0 con 0x7fcb9405edd0 2020-01-26T15:27:43.885 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb84001670 con 0x7fcb9405edd0 2020-01-26T15:27:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb84001940 con 0x7fcb9405edd0 2020-01-26T15:27:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb92ffd700 1 -- 172.21.15.129:0/984688403 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb840044f0 con 0x7fcb9405edd0 2020-01-26T15:27:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 -- 172.21.15.129:0/984688403 >> v1:172.21.15.129:6790/0 conn(0x7fcb9405edd0 legacy=0x7fcb9407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 -- 172.21.15.129:0/984688403 shutdown_connections 2020-01-26T15:27:43.886 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 --2- 172.21.15.129:0/984688403 >> v2:172.21.15.129:6791/0 conn(0x7fcb940a6870 0x7fcb9414c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 -- 172.21.15.129:0/984688403 >> 172.21.15.129:0/984688403 conn(0x7fcb94098e70 msgr2=0x7fcb940a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 -- 172.21.15.129:0/984688403 shutdown_connections 2020-01-26T15:27:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.874+0000 7fcb93fff700 1 -- 172.21.15.129:0/984688403 wait complete. 2020-01-26T15:27:43.887 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 Processor -- start 2020-01-26T15:27:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- start start 2020-01-26T15:27:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb94137c80 0x7fcb9413a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9411f8b0 con 0x7fcb94120940 2020-01-26T15:27:43.888 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb94120210 con 0x7fcb94120510 2020-01-26T15:27:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940a7870 con 0x7fcb94137c80 2020-01-26T15:27:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb99718700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcb94137c80 0x7fcb9413a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fcb94120510 0x7fcb94079e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49508/0 (socket says 172.21.15.129:49508) 2020-01-26T15:27:43.889 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 -- 172.21.15.129:0/3075310867 learned_addr learned my addr 172.21.15.129:0/3075310867 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb99718700 1 --2- 172.21.15.129:0/3075310867 >> v2:172.21.15.129:6790/0 conn(0x7fcb94137c80 0x7fcb9413a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223999005 0 0) 0x7fcb94120210 con 0x7fcb94120510 2020-01-26T15:27:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb78003230 con 0x7fcb94120510 2020-01-26T15:27:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017800026 0 0) 0x7fcb80003230 con 0x7fcb94120940 2020-01-26T15:27:43.890 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94120210 con 0x7fcb94120940 2020-01-26T15:27:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3307876093 0 0) 0x7fcb94120210 con 0x7fcb94120940 2020-01-26T15:27:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb80003230 con 0x7fcb94120940 2020-01-26T15:27:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcb7c001810 con 0x7fcb94120940 2020-01-26T15:27:43.891 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 >> v2:172.21.15.129:6790/0 conn(0x7fcb94137c80 msgr2=0x7fcb9413a0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:43.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 --2- 172.21.15.129:0/3075310867 >> v2:172.21.15.129:6790/0 conn(0x7fcb94137c80 0x7fcb9413a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:43.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 >> v1:172.21.15.129:6790/0 conn(0x7fcb94120510 legacy=0x7fcb94079e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 >> v1:172.21.15.129:6789/0 conn(0x7fcb94120940 legacy=0x7fcb94136470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:43.892 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fcb94120210 con 0x7fcb78003ec0 2020-01-26T15:27:43.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fcb780042f0 con 0x7fcb78003a90 2020-01-26T15:27:43.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940a7870 con 0x7fcb78004c90 2020-01-26T15:27:43.893 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120544990 0 0) 0x7fcb780042f0 con 0x7fcb78003a90 2020-01-26T15:27:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7800e810 con 0x7fcb78003a90 2020-01-26T15:27:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049476189 0 0) 0x7fcb94120210 con 0x7fcb78003ec0 2020-01-26T15:27:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 -- 172.21.15.129:0/3075310867 >> v1:172.21.15.129:6791/0 conn(0x7fcb78003a90 legacy=0x7fcb780097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.894 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 -- 172.21.15.129:0/3075310867 >> v1:172.21.15.129:6790/0 conn(0x7fcb78003ec0 legacy=0x7fcb7800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9411f3c0 con 0x7fcb78004c90 2020-01-26T15:27:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94120d70 con 0x7fcb78004c90 2020-01-26T15:27:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb941213f0 con 0x7fcb78004c90 2020-01-26T15:27:43.895 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fcb8400cc00 con 0x7fcb78004c90 2020-01-26T15:27:43.896 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400ce00 con 0x7fcb78004c90 2020-01-26T15:27:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.878+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fcb84004970 con 0x7fcb78004c90 2020-01-26T15:27:43.897 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.882+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.898 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.882+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c003360 con 0x7fcb78004c90 2020-01-26T15:27:43.898 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.882+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fcb84004b70 con 0x7fcb78004c90 2020-01-26T15:27:43.898 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.882+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.882+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fcb8404d030 con 0x7fcb78004c90 2020-01-26T15:27:43.899 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.886+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:43.900 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:43.886+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fcb840331e0 con 0x7fcb78004c90 2020-01-26T15:27:44.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.042+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcb6c003790 con 0x7fcb78004c90 2020-01-26T15:27:44.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb937fe700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:44.043 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb90ff9700 1 -- 172.21.15.129:0/3075310867 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fcb84033440 con 0x7fcb78004c90 2020-01-26T15:27:44.043 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 >> v1:172.21.15.129:6800/16899 conn(0x7fcb78048510 legacy=0x7fcb7804aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 msgr2=0x7fcb78003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 --2- 172.21.15.129:0/3075310867 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fcb78004c90 0x7fcb78003540 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7fcb84001580 tx=0x7fcb84010d40).stop 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb99718700 1 -- 172.21.15.129:0/3075310867 reap_dead start 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb99718700 1 -- 172.21.15.129:0/3075310867 reap_dead start 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 shutdown_connections 2020-01-26T15:27:44.045 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 >> 172.21.15.129:0/3075310867 conn(0x7fcb940a67d0 msgr2=0x7fcb94122680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 shutdown_connections 2020-01-26T15:27:44.046 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:44.046+0000 7fcb93fff700 1 -- 172.21.15.129:0/3075310867 wait complete. 2020-01-26T15:27:44.056 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:47.057 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 Processor -- start 2020-01-26T15:27:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 -- start start 2020-01-26T15:27:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0f6005edd0 0x7f0f6005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f0f600a6870 0x7f0f6007ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:47.180 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f60098000 con 0x7f0f600804d0 2020-01-26T15:27:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6005e050 con 0x7f0f6005edd0 2020-01-26T15:27:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600a6ca0 con 0x7f0f600a6870 2020-01-26T15:27:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f66444700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f0f600804d0 0x7f0f600247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41226/0 (socket says 172.21.15.129:41226) 2020-01-26T15:27:47.181 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f66444700 1 -- 172.21.15.129:0/528954593 learned_addr learned my addr 172.21.15.129:0/528954593 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5ffff700 -1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6791/0 conn(0x7f0f600a6870 0x7f0f6007ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 -1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6790/0 conn(0x7f0f6005edd0 0x7f0f6005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6790/0 conn(0x7f0f6005edd0 0x7f0f6005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5ffff700 1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6791/0 conn(0x7f0f600a6870 0x7f0f6007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998005855 0 0) 0x7f0f60098000 con 0x7f0f600804d0 2020-01-26T15:27:47.182 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c003230 con 0x7f0f600804d0 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2065182121 0 0) 0x7f0f4c003230 con 0x7f0f600804d0 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6791/0 conn(0x7f0f600a6870 msgr2=0x7f0f6007ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6791/0 conn(0x7f0f600a6870 0x7f0f6007ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6790/0 conn(0x7f0f6005edd0 msgr2=0x7f0f6005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 --2- 172.21.15.129:0/528954593 >> v2:172.21.15.129:6790/0 conn(0x7f0f6005edd0 0x7f0f6005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:47.183 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60024fb0 con 0x7f0f600804d0 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0f58001710 con 0x7f0f600804d0 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 >> v1:172.21.15.129:6789/0 conn(0x7f0f600804d0 legacy=0x7f0f600247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0f4c003230 con 0x7f0f4c0045a0 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0f60098000 con 0x7f0f4c00a7f0 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6005e050 con 0x7f0f4c003860 2020-01-26T15:27:47.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698479677 0 0) 0x7f0f60098000 con 0x7f0f4c00a7f0 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c00e520 con 0x7f0f4c00a7f0 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998795257 0 0) 0x7f0f4c003230 con 0x7f0f4c0045a0 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f60098000 con 0x7f0f4c0045a0 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 -- 172.21.15.129:0/528954593 >> v1:172.21.15.129:6791/0 conn(0x7f0f4c00a7f0 legacy=0x7f0f4c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 -- 172.21.15.129:0/528954593 >> v1:172.21.15.129:6790/0 conn(0x7f0f4c0045a0 legacy=0x7f0f4c0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 -- 172.21.15.129:0/528954593 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c054470 con 0x7f0f4c003860 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f66444700 1 -- 172.21.15.129:0/528954593 reap_dead start 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f50008c80 tx=0x7f0f500101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f50008c80 tx=0x7f0f500101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f500101e0).ready entity=mon.0 client_cookie=28c26bb5c551b012 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:47.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f500101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0f50007310 con 0x7f0f4c003860 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f500101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f649e1700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f500101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f50007510 con 0x7f0f4c003860 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f5f7fe700 1 -- 172.21.15.129:0/528954593 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0f500078b0 con 0x7f0f4c003860 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 -- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 msgr2=0x7f0f4c003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.178+0000 7f0f651e2700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f500101e0).stop 2020-01-26T15:27:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- 172.21.15.129:0/528954593 shutdown_connections 2020-01-26T15:27:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 --2- 172.21.15.129:0/528954593 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f4c003860 0x7f0f4c003cd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- 172.21.15.129:0/528954593 >> 172.21.15.129:0/528954593 conn(0x7f0f60098e70 msgr2=0x7f0f600a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- 172.21.15.129:0/528954593 shutdown_connections 2020-01-26T15:27:47.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- 172.21.15.129:0/528954593 wait complete. 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 Processor -- start 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- start start 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0f60061410 0x7f0f60062670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6007ed60 con 0x7f0f60062bc0 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f60060220 con 0x7f0f60130ee0 2020-01-26T15:27:47.193 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f651e2700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6009dd00 con 0x7f0f60061410 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f66444700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f0f60130ee0 0x7f0f60137ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47152/0 (socket says 172.21.15.129:47152) 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f649e1700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0f60061410 0x7f0f60062670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f66444700 1 -- 172.21.15.129:0/3013975483 learned_addr learned my addr 172.21.15.129:0/3013975483 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> v2:172.21.15.129:6790/0 conn(0x7f0f60061410 0x7f0f60062670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072069937 0 0) 0x7f0f6007ed60 con 0x7f0f60062bc0 2020-01-26T15:27:47.200 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f44003230 con 0x7f0f60062bc0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599638118 0 0) 0x7f0f60060220 con 0x7f0f60130ee0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.182+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6007ed60 con 0x7f0f60130ee0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 95233462 0 0) 0x7f0f44003230 con 0x7f0f60062bc0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0f60060220 con 0x7f0f60062bc0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0f48001730 con 0x7f0f60062bc0 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 >> v2:172.21.15.129:6790/0 conn(0x7f0f60061410 msgr2=0x7f0f60062670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:47.201 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 --2- 172.21.15.129:0/3013975483 >> v2:172.21.15.129:6790/0 conn(0x7f0f60061410 0x7f0f60062670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 >> v1:172.21.15.129:6791/0 conn(0x7f0f60130ee0 legacy=0x7f0f60137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 >> v1:172.21.15.129:6789/0 conn(0x7f0f60062bc0 legacy=0x7f0f601306e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0f6007ed60 con 0x7f0f4400a7f0 2020-01-26T15:27:47.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0f44003230 con 0x7f0f44004060 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6009dd00 con 0x7f0f44003c30 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285359226 0 0) 0x7f0f6007ed60 con 0x7f0f4400a7f0 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4400e500 con 0x7f0f4400a7f0 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928386569 0 0) 0x7f0f44003230 con 0x7f0f44004060 2020-01-26T15:27:47.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6007ed60 con 0x7f0f44004060 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 -- 172.21.15.129:0/3013975483 >> v1:172.21.15.129:6791/0 conn(0x7f0f44004060 legacy=0x7f0f44004af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 -- 172.21.15.129:0/3013975483 >> v1:172.21.15.129:6790/0 conn(0x7f0f4400a7f0 legacy=0x7f0f4400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60097b60 con 0x7f0f44003c30 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6009c0e0 con 0x7f0f44003c30 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f60060f90 con 0x7f0f44003c30 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.204 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0f5000f460 con 0x7f0f44003c30 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500078c0 con 0x7f0f44003c30 2020-01-26T15:27:47.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f0f5000f810 con 0x7f0f44003c30 2020-01-26T15:27:47.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f38003360 con 0x7f0f44003c30 2020-01-26T15:27:47.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.186+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.190+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f0f5000fa10 con 0x7f0f44003c30 2020-01-26T15:27:47.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.190+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.190+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f0f500020c0 con 0x7f0f44003c30 2020-01-26T15:27:47.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.194+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.207 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.194+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f0f50036870 con 0x7f0f44003c30 2020-01-26T15:27:47.346 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.346+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0f380036b0 con 0x7f0f44003c30 2020-01-26T15:27:47.347 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.346+0000 7f0f649e1700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:47.347 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.346+0000 7f0f5d7fa700 1 -- 172.21.15.129:0/3013975483 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f0f50036ad0 con 0x7f0f44003c30 2020-01-26T15:27:47.347 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:47.349 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 >> v1:172.21.15.129:6800/16899 conn(0x7f0f44048130 legacy=0x7f0f4404a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.349 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 msgr2=0x7f0f440045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f0f50008c80 tx=0x7f0f50007490).stop 2020-01-26T15:27:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f66444700 1 -- 172.21.15.129:0/3013975483 reap_dead start 2020-01-26T15:27:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 shutdown_connections 2020-01-26T15:27:47.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 --2- 172.21.15.129:0/3013975483 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0f44003c30 0x7f0f440045a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 >> 172.21.15.129:0/3013975483 conn(0x7f0f60098e10 msgr2=0x7f0f6009fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 shutdown_connections 2020-01-26T15:27:47.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:47.350+0000 7f0f651e2700 1 -- 172.21.15.129:0/3013975483 wait complete. 2020-01-26T15:27:47.360 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:50.361 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:50.485 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 Processor -- start 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 -- start start 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb18005edd0 0x7fb18005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb180149040 0x7fb18014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb180098000 con 0x7fb1800a6870 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb18005e050 con 0x7fb18005edd0 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1866c7700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb1800a6ca0 con 0x7fb180149040 2020-01-26T15:27:50.486 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb185ec6700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb18005edd0 0x7fb18005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb187929700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb180149040 0x7fb18014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1856c5700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb1800a6870 0x7fb18007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41248/0 (socket says 172.21.15.129:41248) 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb187929700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb180149040 0x7fb18014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb185ec6700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb18005edd0 0x7fb18005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1856c5700 1 -- 172.21.15.129:0/2580351 learned_addr learned my addr 172.21.15.129:0/2580351 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588304277 0 0) 0x7fb180098000 con 0x7fb1800a6870 2020-01-26T15:27:50.487 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c003230 con 0x7fb1800a6870 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3498276898 0 0) 0x7fb16c003230 con 0x7fb1800a6870 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 >> v2:172.21.15.129:6791/0 conn(0x7fb180149040 msgr2=0x7fb18014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 --2- 172.21.15.129:0/2580351 >> v2:172.21.15.129:6791/0 conn(0x7fb180149040 0x7fb18014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 >> v2:172.21.15.129:6790/0 conn(0x7fb18005edd0 msgr2=0x7fb18005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 --2- 172.21.15.129:0/2580351 >> v2:172.21.15.129:6790/0 conn(0x7fb18005edd0 0x7fb18005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18014c9e0 con 0x7fb1800a6870 2020-01-26T15:27:50.488 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb170001710 con 0x7fb1800a6870 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 >> v1:172.21.15.129:6789/0 conn(0x7fb1800a6870 legacy=0x7fb18007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb16c003230 con 0x7fb16c0038e0 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb180098000 con 0x7fb16c00a7f0 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18005e050 con 0x7fb16c0045c0 2020-01-26T15:27:50.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.482+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805204339 0 0) 0x7fb16c003230 con 0x7fb16c0038e0 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c00e520 con 0x7fb16c0038e0 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537017494 0 0) 0x7fb180098000 con 0x7fb16c00a7f0 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 -- 172.21.15.129:0/2580351 >> v1:172.21.15.129:6791/0 conn(0x7fb16c00a7f0 legacy=0x7fb16c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 -- 172.21.15.129:0/2580351 >> v1:172.21.15.129:6790/0 conn(0x7fb16c0038e0 legacy=0x7fb16c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb187929700 1 -- 172.21.15.129:0/2580351 reap_dead start 2020-01-26T15:27:50.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 -- 172.21.15.129:0/2580351 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c054530 con 0x7fb16c0045c0 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb170001000 tx=0x7fb17000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb170001000 tx=0x7fb17000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fb170001000 tx=0x7fb17000c1e0).ready entity=mon.0 client_cookie=c8f87d69400560a server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb170001000 tx=0x7fb17000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb17000e160 con 0x7fb16c0045c0 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb170001000 tx=0x7fb17000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1856c5700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fb170001000 tx=0x7fb17000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17000e360 con 0x7fb16c0045c0 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb184ec4700 1 -- 172.21.15.129:0/2580351 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb1700100b0 con 0x7fb16c0045c0 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 msgr2=0x7fb16c004ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fb170001000 tx=0x7fb17000c1e0).stop 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- 172.21.15.129:0/2580351 shutdown_connections 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 --2- 172.21.15.129:0/2580351 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb16c0045c0 0x7fb16c004ac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- 172.21.15.129:0/2580351 >> 172.21.15.129:0/2580351 conn(0x7fb180098e70 msgr2=0x7fb1800a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:50.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- 172.21.15.129:0/2580351 shutdown_connections 2020-01-26T15:27:50.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- 172.21.15.129:0/2580351 wait complete. 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 Processor -- start 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.486+0000 7fb1866c7700 1 -- start start 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb1800a44e0 0x7fb18009df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1800a49f0 con 0x7fb18007d6a0 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb180099c30 con 0x7fb1800a30f0 2020-01-26T15:27:50.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb180121690 con 0x7fb1800a44e0 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1856c5700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fb1800a30f0 0x7fb18007cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47176/0 (socket says 172.21.15.129:47176) 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1856c5700 1 -- 172.21.15.129:0/3038902713 learned_addr learned my addr 172.21.15.129:0/3038902713 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb185ec6700 -1 --2- 172.21.15.129:0/3038902713 >> v2:172.21.15.129:6790/0 conn(0x7fb1800a44e0 0x7fb18009df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb185ec6700 1 --2- 172.21.15.129:0/3038902713 >> v2:172.21.15.129:6790/0 conn(0x7fb1800a44e0 0x7fb18009df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121667904 0 0) 0x7fb1800a49f0 con 0x7fb18007d6a0 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb168003230 con 0x7fb18007d6a0 2020-01-26T15:27:50.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956624650 0 0) 0x7fb180099c30 con 0x7fb1800a30f0 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1800a49f0 con 0x7fb1800a30f0 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1597715110 0 0) 0x7fb168003230 con 0x7fb18007d6a0 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb180099c30 con 0x7fb18007d6a0 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb178002980 con 0x7fb18007d6a0 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 >> v2:172.21.15.129:6790/0 conn(0x7fb1800a44e0 msgr2=0x7fb18009df00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 --2- 172.21.15.129:0/3038902713 >> v2:172.21.15.129:6790/0 conn(0x7fb1800a44e0 0x7fb18009df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 >> v1:172.21.15.129:6791/0 conn(0x7fb1800a30f0 legacy=0x7fb18007cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 >> v1:172.21.15.129:6789/0 conn(0x7fb18007d6a0 legacy=0x7fb1801371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb168003230 con 0x7fb168003c10 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb16800f570 con 0x7fb168004120 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb180121690 con 0x7fb168004e50 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802895287 0 0) 0x7fb16800f570 con 0x7fb168004120 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16800f7a0 con 0x7fb168004120 2020-01-26T15:27:50.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285675516 0 0) 0x7fb168003230 con 0x7fb168003c10 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16800f570 con 0x7fb168003c10 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2313461828 0 0) 0x7fb16800f7a0 con 0x7fb168004120 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 -- 172.21.15.129:0/3038902713 >> v1:172.21.15.129:6791/0 conn(0x7fb168004120 legacy=0x7fb16800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 -- 172.21.15.129:0/3038902713 >> v1:172.21.15.129:6790/0 conn(0x7fb168003c10 legacy=0x7fb1680045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800a40c0 con 0x7fb168004e50 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb180120d00 con 0x7fb168004e50 2020-01-26T15:27:50.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1800a3310 con 0x7fb168004e50 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb1700100b0 con 0x7fb168004e50 2020-01-26T15:27:50.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb178011cf0 con 0x7fb168004e50 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.490+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb17800cc70 con 0x7fb168004e50 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.494+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.494+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c003360 con 0x7fb168004e50 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.494+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fb178005a50 con 0x7fb168004e50 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.494+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.494+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fb17804d110 con 0x7fb168004e50 2020-01-26T15:27:50.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.498+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.498+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fb1780332c0 con 0x7fb168004e50 2020-01-26T15:27:50.655 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb15c003790 con 0x7fb168004e50 2020-01-26T15:27:50.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb187929700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:50.656 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1767fc700 1 -- 172.21.15.129:0/3038902713 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb178005d60 con 0x7fb168004e50 2020-01-26T15:27:50.656 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:50.657 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 >> v1:172.21.15.129:6800/16899 conn(0x7fb168048420 legacy=0x7fb16804a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 msgr2=0x7fb16800e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb187929700 1 -- 172.21.15.129:0/3038902713 reap_dead start 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7fb1700014e0 tx=0x7fb1780112b0).stop 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 shutdown_connections 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 --2- 172.21.15.129:0/3038902713 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb168004e50 0x7fb16800e010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:50.658 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 >> 172.21.15.129:0/3038902713 conn(0x7fb18005edd0 msgr2=0x7fb180122970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:50.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 shutdown_connections 2020-01-26T15:27:50.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:50.658+0000 7fb1866c7700 1 -- 172.21.15.129:0/3038902713 wait complete. 2020-01-26T15:27:50.669 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:53.670 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:53.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 Processor -- start 2020-01-26T15:27:53.794 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 -- start start 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 0x7fdbd014c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd005ea20 con 0x7fdbd005edd0 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd0098000 con 0x7fdbd005e5f0 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd597f700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd005e050 con 0x7fdbd00a6870 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd517e700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdbd005edd0 0x7fdbd007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41274/0 (socket says 172.21.15.129:41274) 2020-01-26T15:27:53.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd517e700 1 -- 172.21.15.129:0/384290055 learned_addr learned my addr 172.21.15.129:0/384290055 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd6be1700 -1 --2- 172.21.15.129:0/384290055 >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 0x7fdbd014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.790+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/384290055 >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 0x7fdbd014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635356332 0 0) 0x7fdbd005ea20 con 0x7fdbd005edd0 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbbc003230 con 0x7fdbd005edd0 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391743828 0 0) 0x7fdbd0098000 con 0x7fdbd005e5f0 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd005ea20 con 0x7fdbd005e5f0 2020-01-26T15:27:53.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 913975049 0 0) 0x7fdbd005ea20 con 0x7fdbd005e5f0 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 msgr2=0x7fdbd014c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 --2- 172.21.15.129:0/384290055 >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 0x7fdbd014c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 >> v1:172.21.15.129:6789/0 conn(0x7fdbd005edd0 legacy=0x7fdbd007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00a6ca0 con 0x7fdbd005e5f0 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbcc0016f0 con 0x7fdbd005e5f0 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdbcc0018f0 con 0x7fdbd005e5f0 2020-01-26T15:27:53.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbc3fff700 1 -- 172.21.15.129:0/384290055 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbcc001ec0 con 0x7fdbd005e5f0 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 -- 172.21.15.129:0/384290055 >> v1:172.21.15.129:6791/0 conn(0x7fdbd005e5f0 legacy=0x7fdbd0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 -- 172.21.15.129:0/384290055 shutdown_connections 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 --2- 172.21.15.129:0/384290055 >> v2:172.21.15.129:6791/0 conn(0x7fdbd00a6870 0x7fdbd014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 -- 172.21.15.129:0/384290055 >> 172.21.15.129:0/384290055 conn(0x7fdbd0098e70 msgr2=0x7fdbd00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 -- 172.21.15.129:0/384290055 shutdown_connections 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.794+0000 7fdbd597f700 1 -- 172.21.15.129:0/384290055 wait complete. 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd597f700 1 Processor -- start 2020-01-26T15:27:53.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd597f700 1 -- start start 2020-01-26T15:27:53.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd597f700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd0121330 con 0x7fdbd009e4c0 2020-01-26T15:27:53.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd597f700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd009a200 con 0x7fdbd007d1e0 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd597f700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd009add0 con 0x7fdbd009e090 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd6be1700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fdbd007d1e0 0x7fdbd01398e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49582/0 (socket says 172.21.15.129:49582) 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd517e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fdbd009e090 0x7fdbd0099a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47196/0 (socket says 172.21.15.129:47196) 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd497d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fdbd009e4c0 0x7fdbd007c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41282/0 (socket says 172.21.15.129:41282) 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd6be1700 1 -- 172.21.15.129:0/673045851 learned_addr learned my addr 172.21.15.129:0/673045851 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132908957 0 0) 0x7fdbd009a200 con 0x7fdbd007d1e0 2020-01-26T15:27:53.804 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb0003230 con 0x7fdbd007d1e0 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869953245 0 0) 0x7fdbd0121330 con 0x7fdbd009e4c0 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd009a200 con 0x7fdbd009e4c0 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575618778 0 0) 0x7fdbd009add0 con 0x7fdbd009e090 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0121330 con 0x7fdbd009e090 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1452441261 0 0) 0x7fdbb0003230 con 0x7fdbd007d1e0 2020-01-26T15:27:53.805 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbd009add0 con 0x7fdbd007d1e0 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbc8002a50 con 0x7fdbd007d1e0 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 742816815 0 0) 0x7fdbd009a200 con 0x7fdbd009e4c0 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbb0003230 con 0x7fdbd009e4c0 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbcc001a00 con 0x7fdbd009e4c0 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6791/0 conn(0x7fdbd009e090 legacy=0x7fdbd0099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6790/0 conn(0x7fdbd007d1e0 legacy=0x7fdbd01398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.806 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6789/0 conn(0x7fdbd009e4c0 legacy=0x7fdbd007c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdbd009a200 con 0x7fdbb0003da0 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fdbb000f9a0 con 0x7fdbb0005130 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb0010be0 con 0x7fdbb000c000 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484172044 0 0) 0x7fdbb000f9a0 con 0x7fdbb0005130 2020-01-26T15:27:53.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb000e990 con 0x7fdbb0005130 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698566530 0 0) 0x7fdbd009a200 con 0x7fdbb0003da0 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb000f9a0 con 0x7fdbb0003da0 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.798+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4103667559 0 0) 0x7fdbb000f9a0 con 0x7fdbb0003da0 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbd009a200 con 0x7fdbb0003da0 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbcc002400 con 0x7fdbb0003da0 2020-01-26T15:27:53.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 448551845 0 0) 0x7fdbb000e990 con 0x7fdbb0005130 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdbb000f9a0 con 0x7fdbb0005130 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fdbc4001810 con 0x7fdbb0005130 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6791/0 conn(0x7fdbb0005130 legacy=0x7fdbb0003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6790/0 conn(0x7fdbb0003da0 legacy=0x7fdbb000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fdbd00a1270 con 0x7fdbb000c000 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd009e090 con 0x7fdbb000c000 2020-01-26T15:27:53.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd0099a00 con 0x7fdbb000c000 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fdbc8005c90 con 0x7fdbb000c000 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800e160 con 0x7fdbb000c000 2020-01-26T15:27:53.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8003360 con 0x7fdbb000c000 2020-01-26T15:27:53.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fdbc800e350 con 0x7fdbb000c000 2020-01-26T15:27:53.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.811 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.802+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fdbc804db60 con 0x7fdbb000c000 2020-01-26T15:27:53.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.810+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.812 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.810+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fdbc8033cb0 con 0x7fdbb000c000 2020-01-26T15:27:53.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdba8003790 con 0x7fdbb000c000 2020-01-26T15:27:53.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd6be1700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:27:53.964 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbc1ffb700 1 -- 172.21.15.129:0/673045851 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fdbc8033f10 con 0x7fdbb000c000 2020-01-26T15:27:53.964 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 >> v1:172.21.15.129:6800/16899 conn(0x7fdbb0048cc0 legacy=0x7fdbb004b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 msgr2=0x7fdbb000e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 --2- 172.21.15.129:0/673045851 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fdbb000c000 0x7fdbb000e440 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7fdbc8002390 tx=0x7fdbc4001090).stop 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd6be1700 1 -- 172.21.15.129:0/673045851 reap_dead start 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 shutdown_connections 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 >> 172.21.15.129:0/673045851 conn(0x7fdbd005c0b0 msgr2=0x7fdbd00a3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:53.966 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 shutdown_connections 2020-01-26T15:27:53.967 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:53.966+0000 7fdbd597f700 1 -- 172.21.15.129:0/673045851 wait complete. 2020-01-26T15:27:53.977 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:27:56.978 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:27:57.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 Processor -- start 2020-01-26T15:27:57.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 -- start start 2020-01-26T15:27:57.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 0x7f1b0c0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:57.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 0x7f1b0c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:27:57.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c0a6dc0 con 0x7f1b0c05edd0 2020-01-26T15:27:57.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c05ea20 con 0x7f1b0c05e5f0 2020-01-26T15:27:57.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b10876700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c098000 con 0x7f1b0c149040 2020-01-26T15:27:57.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b11077700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 0x7f1b0c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:57.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b11077700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 0x7f1b0c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b0ad9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 0x7f1b0c0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b0b59e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1b0c05edd0 0x7f1b0c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49594/0 (socket says 172.21.15.129:49594) 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b0b59e700 1 -- 172.21.15.129:0/1886313903 learned_addr learned my addr 172.21.15.129:0/1886313903 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.094+0000 7f1b0ad9d700 1 --2- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 0x7f1b0c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379405035 0 0) 0x7f1b0c0a6dc0 con 0x7f1b0c05edd0 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af4003230 con 0x7f1b0c05edd0 2020-01-26T15:27:57.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2366218936 0 0) 0x7f1af4003230 con 0x7f1b0c05edd0 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 msgr2=0x7f1b0c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 --2- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 0x7f1b0c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 msgr2=0x7f1b0c0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 --2- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 0x7f1b0c0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c05e050 con 0x7f1b0c05edd0 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1afc001a90 con 0x7f1b0c05edd0 2020-01-26T15:27:57.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1afc001e20 con 0x7f1b0c05edd0 2020-01-26T15:27:57.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b0a59c700 1 -- 172.21.15.129:0/1886313903 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1afc004ae0 con 0x7f1b0c05edd0 2020-01-26T15:27:57.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 -- 172.21.15.129:0/1886313903 >> v1:172.21.15.129:6790/0 conn(0x7f1b0c05edd0 legacy=0x7f1b0c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:57.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 -- 172.21.15.129:0/1886313903 shutdown_connections 2020-01-26T15:27:57.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 --2- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c149040 0x7f1b0c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:57.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 --2- 172.21.15.129:0/1886313903 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c05e5f0 0x7f1b0c0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:27:57.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 -- 172.21.15.129:0/1886313903 >> 172.21.15.129:0/1886313903 conn(0x7f1b0c098e70 msgr2=0x7f1b0c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:57.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 -- 172.21.15.129:0/1886313903 shutdown_connections 2020-01-26T15:27:57.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.098+0000 7f1b10876700 1 -- 172.21.15.129:0/1886313903 wait complete. 2020-01-26T15:27:57.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 Processor -- start 2020-01-26T15:27:57.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- start start 2020-01-26T15:27:57.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 0x7f1b0c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:57.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 0x7f1b0c07dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c0a4e00 con 0x7f1b0c07e150 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0a1fc0 con 0x7f1b0c0a40e0 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0a2510 con 0x7f1b0c099f50 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b0ad9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 0x7f1b0c07dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b0ad9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 0x7f1b0c07dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:57.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b0b59e700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 0x7f1b0c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b11077700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f1b0c07e150 0x7f1b0c07c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49606/0 (socket says 172.21.15.129:49606) 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b11077700 1 -- 172.21.15.129:0/221632818 learned_addr learned my addr 172.21.15.129:0/221632818 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b0b59e700 1 --2- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 0x7f1b0c099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080679870 0 0) 0x7f1b0c0a4e00 con 0x7f1b0c07e150 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aec003230 con 0x7f1b0c07e150 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3292788769 0 0) 0x7f1aec003230 con 0x7f1b0c07e150 2020-01-26T15:27:57.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1b0c0a4e00 con 0x7f1b0c07e150 2020-01-26T15:27:57.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1b04001620 con 0x7f1b0c07e150 2020-01-26T15:27:57.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1668430033 0 0) 0x7f1b0c0a4e00 con 0x7f1b0c07e150 2020-01-26T15:27:57.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 msgr2=0x7f1b0c07dc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:57.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 --2- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 0x7f1b0c07dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:57.108 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 msgr2=0x7f1b0c099a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:27:57.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 --2- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 0x7f1b0c099a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:57.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c09a380 con 0x7f1b0c07e150 2020-01-26T15:27:57.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c121a70 con 0x7f1b0c07e150 2020-01-26T15:27:57.109 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1b04001ec0 con 0x7f1b0c07e150 2020-01-26T15:27:57.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c0a3c40 con 0x7f1b0c07e150 2020-01-26T15:27:57.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.102+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1b040022a0 con 0x7f1b0c07e150 2020-01-26T15:27:57.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.106+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c0a3ee0 con 0x7f1b0c07e150 2020-01-26T15:27:57.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.106+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f1b040024a0 con 0x7f1b0c07e150 2020-01-26T15:27:57.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.106+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f1b0404ba90 con 0x7f1b0c07e150 2020-01-26T15:27:57.112 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.114+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f1b04030fb0 con 0x7f1b0c07e150 2020-01-26T15:27:57.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.270+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1b0c05c510 con 0x7f1b0c07e150 2020-01-26T15:27:57.269 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.270+0000 7f1af3fff700 1 -- 172.21.15.129:0/221632818 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f1b04002c00 con 0x7f1b0c07e150 2020-01-26T15:27:57.270 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:27:57.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 >> v1:172.21.15.129:6800/16899 conn(0x7f1aec03e0a0 legacy=0x7f1aec0405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:57.270 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 >> v1:172.21.15.129:6790/0 conn(0x7f1b0c07e150 legacy=0x7f1b0c07c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:27:57.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 shutdown_connections 2020-01-26T15:27:57.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 --2- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6790/0 conn(0x7f1b0c0a40e0 0x7f1b0c099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:57.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 --2- 172.21.15.129:0/221632818 >> v2:172.21.15.129:6791/0 conn(0x7f1b0c099f50 0x7f1b0c07dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:27:57.271 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 >> 172.21.15.129:0/221632818 conn(0x7f1b0c0a1150 msgr2=0x7f1b0c024bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:27:57.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 shutdown_connections 2020-01-26T15:27:57.272 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:27:57.274+0000 7f1b10876700 1 -- 172.21.15.129:0/221632818 wait complete. 2020-01-26T15:27:57.282 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:00.284 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:00.410 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 Processor -- start 2020-01-26T15:28:00.410 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 -- start start 2020-01-26T15:28:00.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb95805edd0 0x7fb95805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:00.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958098000 con 0x7fb958149040 2020-01-26T15:28:00.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95805e050 con 0x7fb9580a6870 2020-01-26T15:28:00.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb957fff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580a6ca0 con 0x7fb95805edd0 2020-01-26T15:28:00.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb956ffd700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb9580a6870 0x7fb95807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49612/0 (socket says 172.21.15.129:49612) 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb956ffd700 1 -- 172.21.15.129:0/334013931 learned_addr learned my addr 172.21.15.129:0/334013931 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9577fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb95805edd0 0x7fb95805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> v2:172.21.15.129:6791/0 conn(0x7fb95805edd0 0x7fb95805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450195010 0 0) 0x7fb95805e050 con 0x7fb9580a6870 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb940003230 con 0x7fb9580a6870 2020-01-26T15:28:00.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272127930 0 0) 0x7fb958098000 con 0x7fb958149040 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.406+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb95805e050 con 0x7fb958149040 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 129740878 0 0) 0x7fb95805e050 con 0x7fb958149040 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 >> v2:172.21.15.129:6791/0 conn(0x7fb95805edd0 msgr2=0x7fb95805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 --2- 172.21.15.129:0/334013931 >> v2:172.21.15.129:6791/0 conn(0x7fb95805edd0 0x7fb95805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 >> v1:172.21.15.129:6790/0 conn(0x7fb9580a6870 legacy=0x7fb95807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.417 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95814ecb0 con 0x7fb958149040 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb950001a70 con 0x7fb958149040 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 >> v1:172.21.15.129:6789/0 conn(0x7fb958149040 legacy=0x7fb95814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb95805e050 con 0x7fb940003540 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb940003230 con 0x7fb94000a7f0 2020-01-26T15:28:00.418 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580a6ca0 con 0x7fb940004b20 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352986561 0 0) 0x7fb95805e050 con 0x7fb940003540 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb958098000 con 0x7fb940003540 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261287258 0 0) 0x7fb940003230 con 0x7fb94000a7f0 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb95805e050 con 0x7fb94000a7f0 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 -- 172.21.15.129:0/334013931 >> v1:172.21.15.129:6791/0 conn(0x7fb94000a7f0 legacy=0x7fb94000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.419 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 -- 172.21.15.129:0/334013931 >> v1:172.21.15.129:6790/0 conn(0x7fb940003540 legacy=0x7fb940003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 -- 172.21.15.129:0/334013931 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940054530 con 0x7fb940004b20 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb948008900 tx=0x7fb94800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb948008900 tx=0x7fb94800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fb948008900 tx=0x7fb94800fe60).ready entity=mon.0 client_cookie=54226c09ef3db5ca server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fb948008900 tx=0x7fb94800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb948008ca0 con 0x7fb940004b20 2020-01-26T15:28:00.420 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fb948008900 tx=0x7fb94800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948005780 con 0x7fb940004b20 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9577fe700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7fb948008900 tx=0x7fb94800fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb9567fc700 1 -- 172.21.15.129:0/334013931 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb948005b60 con 0x7fb940004b20 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 -- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 msgr2=0x7fb940004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 --2- 172.21.15.129:0/334013931 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb940004b20 0x7fb940004f50 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7fb948008900 tx=0x7fb94800fe60).stop 2020-01-26T15:28:00.421 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb95d995700 1 -- 172.21.15.129:0/334013931 reap_dead start 2020-01-26T15:28:00.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 -- 172.21.15.129:0/334013931 shutdown_connections 2020-01-26T15:28:00.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 -- 172.21.15.129:0/334013931 >> 172.21.15.129:0/334013931 conn(0x7fb958098e70 msgr2=0x7fb9580a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:00.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 -- 172.21.15.129:0/334013931 shutdown_connections 2020-01-26T15:28:00.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.410+0000 7fb957fff700 1 -- 172.21.15.129:0/334013931 wait complete. 2020-01-26T15:28:00.422 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 Processor -- start 2020-01-26T15:28:00.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- start start 2020-01-26T15:28:00.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 0x7fb958078dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:00.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958120d50 con 0x7fb958079320 2020-01-26T15:28:00.423 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958079750 con 0x7fb958122c60 2020-01-26T15:28:00.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580257c0 con 0x7fb9580789a0 2020-01-26T15:28:00.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb9577fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fb958122c60 0x7fb95807dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47238/0 (socket says 172.21.15.129:47238) 2020-01-26T15:28:00.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb9577fe700 1 -- 172.21.15.129:0/1324578150 learned_addr learned my addr 172.21.15.129:0/1324578150 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:00.424 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb956ffd700 -1 --2- 172.21.15.129:0/1324578150 >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 0x7fb958078dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb956ffd700 1 --2- 172.21.15.129:0/1324578150 >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 0x7fb958078dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50608052 0 0) 0x7fb958079750 con 0x7fb958122c60 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb938003230 con 0x7fb958122c60 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488607300 0 0) 0x7fb958120d50 con 0x7fb958079320 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb958079750 con 0x7fb958079320 2020-01-26T15:28:00.425 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4128932572 0 0) 0x7fb938003230 con 0x7fb958122c60 2020-01-26T15:28:00.426 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb958120d50 con 0x7fb958122c60 2020-01-26T15:28:00.426 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb948005e00 con 0x7fb958122c60 2020-01-26T15:28:00.426 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2865930074 0 0) 0x7fb958079750 con 0x7fb958079320 2020-01-26T15:28:00.426 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb938003230 con 0x7fb958079320 2020-01-26T15:28:00.426 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb9500046d0 con 0x7fb958079320 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1534096195 0 0) 0x7fb958120d50 con 0x7fb958122c60 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 msgr2=0x7fb958078dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 --2- 172.21.15.129:0/1324578150 >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 0x7fb958078dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 >> v1:172.21.15.129:6790/0 conn(0x7fb958079320 legacy=0x7fb958138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95807d880 con 0x7fb958122c60 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95807f650 con 0x7fb958122c60 2020-01-26T15:28:00.427 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9581206b0 con 0x7fb958122c60 2020-01-26T15:28:00.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb948008680 con 0x7fb958122c60 2020-01-26T15:28:00.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.414+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb948010770 con 0x7fb958122c60 2020-01-26T15:28:00.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.418+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fb9480109f0 con 0x7fb958122c60 2020-01-26T15:28:00.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.418+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb958056600 con 0x7fb958122c60 2020-01-26T15:28:00.428 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.418+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fb94804ce00 con 0x7fb958122c60 2020-01-26T15:28:00.429 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.422+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fb9480321e0 con 0x7fb958122c60 2020-01-26T15:28:00.578 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.578+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb95805cc60 con 0x7fb958122c60 2020-01-26T15:28:00.579 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb93ffff700 1 -- 172.21.15.129:0/1324578150 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fb948032440 con 0x7fb958122c60 2020-01-26T15:28:00.579 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:00.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 >> v1:172.21.15.129:6800/16899 conn(0x7fb93803e400 legacy=0x7fb938040910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 >> v1:172.21.15.129:6791/0 conn(0x7fb958122c60 legacy=0x7fb95807dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:00.580 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 shutdown_connections 2020-01-26T15:28:00.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 --2- 172.21.15.129:0/1324578150 >> v2:172.21.15.129:6790/0 conn(0x7fb9580789a0 0x7fb958078dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:00.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 >> 172.21.15.129:0/1324578150 conn(0x7fb958098e10 msgr2=0x7fb9580a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:00.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 shutdown_connections 2020-01-26T15:28:00.581 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:00.582+0000 7fb957fff700 1 -- 172.21.15.129:0/1324578150 wait complete. 2020-01-26T15:28:00.592 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:03.593 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 Processor -- start 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- start start 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 0x7fcc6814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6805ea20 con 0x7fcc6805edd0 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc68098000 con 0x7fcc6805e5f0 2020-01-26T15:28:03.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6805e050 con 0x7fcc680a6870 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6d831700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fcc6805edd0 0x7fcc6807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41332/0 (socket says 172.21.15.129:41332) 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6d831700 1 -- 172.21.15.129:0/3664575487 learned_addr learned my addr 172.21.15.129:0/3664575487 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6d030700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fcc6805e5f0 0x7fcc68149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47246/0 (socket says 172.21.15.129:47246) 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6f294700 -1 --2- 172.21.15.129:0/3664575487 >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 0x7fcc6814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6f294700 1 --2- 172.21.15.129:0/3664575487 >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 0x7fcc6814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:03.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056539192 0 0) 0x7fcc68098000 con 0x7fcc6805e5f0 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc54003230 con 0x7fcc6805e5f0 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032863617 0 0) 0x7fcc6805ea20 con 0x7fcc6805edd0 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc68098000 con 0x7fcc6805edd0 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1453258339 0 0) 0x7fcc54003230 con 0x7fcc6805e5f0 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 msgr2=0x7fcc6814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:03.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 --2- 172.21.15.129:0/3664575487 >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 0x7fcc6814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 >> v1:172.21.15.129:6789/0 conn(0x7fcc6805edd0 legacy=0x7fcc6807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680a6ca0 con 0x7fcc6805e5f0 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcc64001710 con 0x7fcc6805e5f0 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcc640019e0 con 0x7fcc6805e5f0 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6c82f700 1 -- 172.21.15.129:0/3664575487 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcc640044f0 con 0x7fcc6805e5f0 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- 172.21.15.129:0/3664575487 >> v1:172.21.15.129:6791/0 conn(0x7fcc6805e5f0 legacy=0x7fcc68149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:03.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- 172.21.15.129:0/3664575487 shutdown_connections 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 --2- 172.21.15.129:0/3664575487 >> v2:172.21.15.129:6791/0 conn(0x7fcc680a6870 0x7fcc6814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- 172.21.15.129:0/3664575487 >> 172.21.15.129:0/3664575487 conn(0x7fcc68098e70 msgr2=0x7fcc680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- 172.21.15.129:0/3664575487 shutdown_connections 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.710+0000 7fcc6e032700 1 -- 172.21.15.129:0/3664575487 wait complete. 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 Processor -- start 2020-01-26T15:28:03.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- start start 2020-01-26T15:28:03.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 0x7fcc680a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc680a1a40 con 0x7fcc68079de0 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6809e150 con 0x7fcc6809ed40 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fcc681224c0 con 0x7fcc68024c60 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6d831700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 0x7fcc680a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6d831700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 0x7fcc680a0290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:03.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6d030700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fcc6809ed40 0x7fcc680a1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49640/0 (socket says 172.21.15.129:49640) 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6d030700 1 -- 172.21.15.129:0/1160144778 learned_addr learned my addr 172.21.15.129:0/1160144778 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998593971 0 0) 0x7fcc6809e150 con 0x7fcc6809ed40 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc50003230 con 0x7fcc6809ed40 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975751388 0 0) 0x7fcc680a1a40 con 0x7fcc68079de0 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc6809e150 con 0x7fcc68079de0 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2729675566 0 0) 0x7fcc50003230 con 0x7fcc6809ed40 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcc680a1a40 con 0x7fcc6809ed40 2020-01-26T15:28:03.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcc640015d0 con 0x7fcc6809ed40 2020-01-26T15:28:03.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2514851782 0 0) 0x7fcc680a1a40 con 0x7fcc6809ed40 2020-01-26T15:28:03.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 msgr2=0x7fcc680a0290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:03.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 --2- 172.21.15.129:0/1160144778 >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 0x7fcc680a0290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:03.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 >> v1:172.21.15.129:6789/0 conn(0x7fcc68079de0 legacy=0x7fcc6807a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:03.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6809e5a0 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6813b9e0 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6813bf60 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.714+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcc64004a70 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.718+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fcc64004c60 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.718+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fcc640106a0 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.718+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68056600 con 0x7fcc6809ed40 2020-01-26T15:28:03.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.718+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fcc6404b8c0 con 0x7fcc6809ed40 2020-01-26T15:28:03.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.722+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fcc64030c40 con 0x7fcc6809ed40 2020-01-26T15:28:03.880 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.882+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcc6805c4e0 con 0x7fcc6809ed40 2020-01-26T15:28:03.881 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.882+0000 7fcc5e7fc700 1 -- 172.21.15.129:0/1160144778 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fcc64030ea0 con 0x7fcc6809ed40 2020-01-26T15:28:03.881 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.882+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 >> v1:172.21.15.129:6800/16899 conn(0x7fcc5003e280 legacy=0x7fcc50040790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.882+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 >> v1:172.21.15.129:6790/0 conn(0x7fcc6809ed40 legacy=0x7fcc680a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.886+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 shutdown_connections 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.886+0000 7fcc6e032700 1 --2- 172.21.15.129:0/1160144778 >> v2:172.21.15.129:6790/0 conn(0x7fcc68024c60 0x7fcc680a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.886+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 >> 172.21.15.129:0/1160144778 conn(0x7fcc68123100 msgr2=0x7fcc680a3600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:03.883 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.886+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 shutdown_connections 2020-01-26T15:28:03.884 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:03.886+0000 7fcc6e032700 1 -- 172.21.15.129:0/1160144778 wait complete. 2020-01-26T15:28:03.900 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:06.901 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:07.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 Processor -- start 2020-01-26T15:28:07.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- start start 2020-01-26T15:28:07.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 0x7fbefc0a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:07.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0a6dc0 con 0x7fbefc149040 2020-01-26T15:28:07.024 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc05ea20 con 0x7fbefc05edd0 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc098000 con 0x7fbefc05e5f0 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefad9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbefc05edd0 0x7fbefc07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49644/0 (socket says 172.21.15.129:49644) 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefa59c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 0x7fbefc0a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefad9d700 1 -- 172.21.15.129:0/2000538979 learned_addr learned my addr 172.21.15.129:0/2000538979 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefa59c700 1 --2- 172.21.15.129:0/2000538979 >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 0x7fbefc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbf00f41700 1 --1- 172.21.15.129:0/2000538979 >> v1:172.21.15.129:6789/0 conn(0x7fbefc149040 0x7fbefc14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41348/0 (socket says 172.21.15.129:41348) 2020-01-26T15:28:07.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255516817 0 0) 0x7fbefc05ea20 con 0x7fbefc05edd0 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee4003230 con 0x7fbefc05edd0 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922270839 0 0) 0x7fbefc0a6dc0 con 0x7fbefc149040 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc05ea20 con 0x7fbefc149040 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3574428108 0 0) 0x7fbee4003230 con 0x7fbefc05edd0 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 msgr2=0x7fbefc0a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:07.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 --2- 172.21.15.129:0/2000538979 >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 0x7fbefc0a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:07.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 >> v1:172.21.15.129:6789/0 conn(0x7fbefc149040 legacy=0x7fbefc14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:07.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc05e050 con 0x7fbefc05edd0 2020-01-26T15:28:07.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbeec001710 con 0x7fbefc05edd0 2020-01-26T15:28:07.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbeec0019e0 con 0x7fbefc05edd0 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbef9d9b700 1 -- 172.21.15.129:0/2000538979 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbeec0045b0 con 0x7fbefc05edd0 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- 172.21.15.129:0/2000538979 >> v1:172.21.15.129:6790/0 conn(0x7fbefc05edd0 legacy=0x7fbefc07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- 172.21.15.129:0/2000538979 shutdown_connections 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 --2- 172.21.15.129:0/2000538979 >> v2:172.21.15.129:6790/0 conn(0x7fbefc05e5f0 0x7fbefc0a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- 172.21.15.129:0/2000538979 >> 172.21.15.129:0/2000538979 conn(0x7fbefc098e70 msgr2=0x7fbefc0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- 172.21.15.129:0/2000538979 shutdown_connections 2020-01-26T15:28:07.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.022+0000 7fbefb59e700 1 -- 172.21.15.129:0/2000538979 wait complete. 2020-01-26T15:28:07.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 Processor -- start 2020-01-26T15:28:07.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- start start 2020-01-26T15:28:07.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 0x7fbefc1227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:07.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 0x7fbefc07d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:07.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc09f5b0 con 0x7fbefc122d00 2020-01-26T15:28:07.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc09e9e0 con 0x7fbefc09f180 2020-01-26T15:28:07.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc09f900 con 0x7fbefc123130 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbf00f41700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 0x7fbefc07d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefa59c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbefc122d00 0x7fbefc07c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49650/0 (socket says 172.21.15.129:49650) 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefad9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 0x7fbefc1227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefa59c700 1 -- 172.21.15.129:0/747412517 learned_addr learned my addr 172.21.15.129:0/747412517 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefad9d700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 0x7fbefc1227b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbf00f41700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 0x7fbefc07d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:07.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730608211 0 0) 0x7fbefc09f5b0 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee0003230 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4102543238 0 0) 0x7fbee0003230 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbefc09f5b0 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbef0002780 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2230213137 0 0) 0x7fbefc09f5b0 con 0x7fbefc122d00 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 msgr2=0x7fbefc07d1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:07.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 0x7fbefc07d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 msgr2=0x7fbefc1227b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 0x7fbefc1227b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc07d730 con 0x7fbefc122d00 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc09e150 con 0x7fbefc122d00 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbef0000e90 con 0x7fbefc122d00 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbef00012b0 con 0x7fbefc122d00 2020-01-26T15:28:07.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.026+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc13acc0 con 0x7fbefc122d00 2020-01-26T15:28:07.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.030+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc123c10 con 0x7fbefc122d00 2020-01-26T15:28:07.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.030+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fbef0001530 con 0x7fbefc122d00 2020-01-26T15:28:07.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.030+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fbef004bad0 con 0x7fbefc122d00 2020-01-26T15:28:07.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.034+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fbef0031050 con 0x7fbefc122d00 2020-01-26T15:28:07.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbefc056600 con 0x7fbefc122d00 2020-01-26T15:28:07.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbeeb7fe700 1 -- 172.21.15.129:0/747412517 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fbef004a740 con 0x7fbefc122d00 2020-01-26T15:28:07.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 >> v1:172.21.15.129:6800/16899 conn(0x7fbee003e170 legacy=0x7fbee0040680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:07.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 >> v1:172.21.15.129:6790/0 conn(0x7fbefc122d00 legacy=0x7fbefc07c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:07.191 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 shutdown_connections 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6791/0 conn(0x7fbefc123130 0x7fbefc07d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 --2- 172.21.15.129:0/747412517 >> v2:172.21.15.129:6790/0 conn(0x7fbefc09f180 0x7fbefc1227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.190+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 >> 172.21.15.129:0/747412517 conn(0x7fbefc098f60 msgr2=0x7fbefc07f100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.194+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 shutdown_connections 2020-01-26T15:28:07.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:07.194+0000 7fbefb59e700 1 -- 172.21.15.129:0/747412517 wait complete. 2020-01-26T15:28:07.208 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:10.209 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:10.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 Processor -- start 2020-01-26T15:28:10.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 -- start start 2020-01-26T15:28:10.334 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0a43f0 con 0x7fc4ec0a32d0 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0a4f20 con 0x7fc4ec080440 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0a0b50 con 0x7fc4ec0a4af0 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f0c6f700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fc4ec080440 0x7fc4ec05eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49658/0 (socket says 172.21.15.129:49658) 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f0c6f700 1 -- 172.21.15.129:0/510168596 learned_addr learned my addr 172.21.15.129:0/510168596 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925853889 0 0) 0x7fc4e4001380 con 0x7fc4ec080440 2020-01-26T15:28:10.335 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d8003230 con 0x7fc4ec080440 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730878243 0 0) 0x7fc4ec0a43f0 con 0x7fc4ec0a32d0 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e4001380 con 0x7fc4ec0a32d0 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151143119 0 0) 0x7fc4ec0a0b50 con 0x7fc4ec0a4af0 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ec0a43f0 con 0x7fc4ec0a4af0 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1486948665 0 0) 0x7fc4d8003230 con 0x7fc4ec080440 2020-01-26T15:28:10.336 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 >> v1:172.21.15.129:6791/0 conn(0x7fc4ec0a4af0 legacy=0x7fc4ec14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 >> v1:172.21.15.129:6789/0 conn(0x7fc4ec0a32d0 legacy=0x7fc4ec05f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec05b180 con 0x7fc4ec080440 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc4e4001bf0 con 0x7fc4ec080440 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc4e4001ec0 con 0x7fc4ec080440 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4eb7fe700 1 -- 172.21.15.129:0/510168596 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc4e4004ae0 con 0x7fc4ec080440 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.326+0000 7fc4f26d2700 1 -- 172.21.15.129:0/510168596 >> v1:172.21.15.129:6790/0 conn(0x7fc4ec080440 legacy=0x7fc4ec05eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.337 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- 172.21.15.129:0/510168596 shutdown_connections 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- 172.21.15.129:0/510168596 >> 172.21.15.129:0/510168596 conn(0x7fc4ec098160 msgr2=0x7fc4ec05e050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- 172.21.15.129:0/510168596 shutdown_connections 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- 172.21.15.129:0/510168596 wait complete. 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 Processor -- start 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- start start 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc4ec062670 0x7fc4ec07c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:10.338 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec062d10 con 0x7fc4ec07cf30 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec093920 con 0x7fc4ec061430 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f26d2700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec061af0 con 0x7fc4ec062670 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4ebfff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc4ec062670 0x7fc4ec07c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f0c6f700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fc4ec061430 0x7fc4ec063790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49664/0 (socket says 172.21.15.129:49664) 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f0c6f700 1 -- 172.21.15.129:0/2335499655 learned_addr learned my addr 172.21.15.129:0/2335499655 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4ebfff700 1 --2- 172.21.15.129:0/2335499655 >> v2:172.21.15.129:6791/0 conn(0x7fc4ec062670 0x7fc4ec07c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:10.339 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484593117 0 0) 0x7fc4ec093920 con 0x7fc4ec061430 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d0003230 con 0x7fc4ec061430 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832796832 0 0) 0x7fc4ec062d10 con 0x7fc4ec07cf30 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ec093920 con 0x7fc4ec07cf30 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1237653280 0 0) 0x7fc4ec093920 con 0x7fc4ec07cf30 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc4ec062d10 con 0x7fc4ec07cf30 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc4d40017f0 con 0x7fc4ec07cf30 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 >> v2:172.21.15.129:6791/0 conn(0x7fc4ec062670 msgr2=0x7fc4ec07c9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:10.340 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 --2- 172.21.15.129:0/2335499655 >> v2:172.21.15.129:6791/0 conn(0x7fc4ec062670 0x7fc4ec07c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 >> v1:172.21.15.129:6790/0 conn(0x7fc4ec061430 legacy=0x7fc4ec063790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 >> v1:172.21.15.129:6789/0 conn(0x7fc4ec07cf30 legacy=0x7fc4ec15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc4d0003230 con 0x7fc4d000a7f0 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc4ec093920 con 0x7fc4d0005140 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec061af0 con 0x7fc4d0004c90 2020-01-26T15:28:10.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.330+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158883262 0 0) 0x7fc4ec093920 con 0x7fc4d0005140 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 -- 172.21.15.129:0/2335499655 >> v1:172.21.15.129:6791/0 conn(0x7fc4d0005140 legacy=0x7fc4d0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 -- 172.21.15.129:0/2335499655 >> v1:172.21.15.129:6790/0 conn(0x7fc4d000a7f0 legacy=0x7fc4d000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec07d360 con 0x7fc4d0004c90 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec061430 con 0x7fc4d0004c90 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec07d630 con 0x7fc4d0004c90 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc4e400b0b0 con 0x7fc4d0004c90 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4015310 con 0x7fc4d0004c90 2020-01-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc4e4013990 con 0x7fc4d0004c90 2020-01-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc4e4013b90 con 0x7fc4d0004c90 2020-01-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c4003360 con 0x7fc4d0004c90 2020-01-26T15:28:10.345 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.334+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc4ec0a4f20 con 0x7fc4d0004c90 2020-01-26T15:28:10.345 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.338+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.345 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.338+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc4e4038730 con 0x7fc4d0004c90 2020-01-26T15:28:10.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc4c4003790 con 0x7fc4d0004c90 2020-01-26T15:28:10.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f0c6f700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:10.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4e97fa700 1 -- 172.21.15.129:0/2335499655 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc4e4038990 con 0x7fc4d0004c90 2020-01-26T15:28:10.492 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:10.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 >> v1:172.21.15.129:6800/16899 conn(0x7fc4d0047f40 legacy=0x7fc4d004a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 msgr2=0x7fc4d0003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:10.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 --2- 172.21.15.129:0/2335499655 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc4d0004c90 0x7fc4d0003540 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7fc4d40010d0 tx=0x7fc4d4001a70).stop 2020-01-26T15:28:10.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f1470700 1 -- 172.21.15.129:0/2335499655 reap_dead start 2020-01-26T15:28:10.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f1470700 1 -- 172.21.15.129:0/2335499655 reap_dead start 2020-01-26T15:28:10.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 shutdown_connections 2020-01-26T15:28:10.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 >> 172.21.15.129:0/2335499655 conn(0x7fc4ec0961b0 msgr2=0x7fc4ec094870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:10.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 shutdown_connections 2020-01-26T15:28:10.494 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:10.494+0000 7fc4f26d2700 1 -- 172.21.15.129:0/2335499655 wait complete. 2020-01-26T15:28:10.510 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:13.512 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 Processor -- start 2020-01-26T15:28:13.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 -- start start 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 0x7fd79005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd790098000 con 0x7fd7900a6870 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79005e050 con 0x7fd790149040 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900a6ca0 con 0x7fd79005edd0 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78ed9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 0x7fd79005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:13.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd794c71700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fd790149040 0x7fd79014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47298/0 (socket says 172.21.15.129:47298) 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd794c71700 1 -- 172.21.15.129:0/2699264089 learned_addr learned my addr 172.21.15.129:0/2699264089 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd787fff700 1 --1- 172.21.15.129:0/2699264089 >> v1:172.21.15.129:6789/0 conn(0x7fd7900a6870 0x7fd79007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41380/0 (socket says 172.21.15.129:41380) 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78ed9d700 1 --2- 172.21.15.129:0/2699264089 >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 0x7fd79005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107905297 0 0) 0x7fd79005e050 con 0x7fd790149040 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c003230 con 0x7fd790149040 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287515920 0 0) 0x7fd790098000 con 0x7fd7900a6870 2020-01-26T15:28:13.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79005e050 con 0x7fd7900a6870 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3340373756 0 0) 0x7fd77c003230 con 0x7fd790149040 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 msgr2=0x7fd79005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 --2- 172.21.15.129:0/2699264089 >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 0x7fd79005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 >> v1:172.21.15.129:6789/0 conn(0x7fd7900a6870 legacy=0x7fd79007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79014ecb0 con 0x7fd790149040 2020-01-26T15:28:13.639 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd788001a90 con 0x7fd790149040 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd788001d60 con 0x7fd790149040 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78e59c700 1 -- 172.21.15.129:0/2699264089 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd788004930 con 0x7fd790149040 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.634+0000 7fd78f59e700 1 -- 172.21.15.129:0/2699264089 >> v1:172.21.15.129:6791/0 conn(0x7fd790149040 legacy=0x7fd79014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- 172.21.15.129:0/2699264089 shutdown_connections 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 --2- 172.21.15.129:0/2699264089 >> v2:172.21.15.129:6790/0 conn(0x7fd79005edd0 0x7fd79005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- 172.21.15.129:0/2699264089 >> 172.21.15.129:0/2699264089 conn(0x7fd790098e70 msgr2=0x7fd7900a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:13.640 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- 172.21.15.129:0/2699264089 shutdown_connections 2020-01-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- 172.21.15.129:0/2699264089 wait complete. 2020-01-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 Processor -- start 2020-01-26T15:28:13.641 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- start start 2020-01-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd790121bd0 0x7fd79007cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79009f910 con 0x7fd79007d160 2020-01-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900a0eb0 con 0x7fd790135240 2020-01-26T15:28:13.645 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78f59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd79009ee00 con 0x7fd790121bd0 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78ed9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd790121bd0 0x7fd79007cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd78ed9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd790121bd0 0x7fd79007cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd794c71700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fd790135240 0x7fd790137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49688/0 (socket says 172.21.15.129:49688) 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd794c71700 1 -- 172.21.15.129:0/315931786 learned_addr learned my addr 172.21.15.129:0/315931786 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.638+0000 7fd787fff700 1 --1- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6789/0 conn(0x7fd79007d160 0x7fd790099a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41386/0 (socket says 172.21.15.129:41386) 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970846841 0 0) 0x7fd79009f910 con 0x7fd79007d160 2020-01-26T15:28:13.646 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd774003230 con 0x7fd79007d160 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139087124 0 0) 0x7fd7900a0eb0 con 0x7fd790135240 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79009f910 con 0x7fd790135240 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3139712279 0 0) 0x7fd774003230 con 0x7fd79007d160 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd7900a0eb0 con 0x7fd79007d160 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1313698956 0 0) 0x7fd79009f910 con 0x7fd790135240 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd774003230 con 0x7fd790135240 2020-01-26T15:28:13.647 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd778001850 con 0x7fd79007d160 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 >> v2:172.21.15.129:6790/0 conn(0x7fd790121bd0 msgr2=0x7fd79007cc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 --2- 172.21.15.129:0/315931786 >> v2:172.21.15.129:6790/0 conn(0x7fd790121bd0 0x7fd79007cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6790/0 conn(0x7fd790135240 legacy=0x7fd790137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6789/0 conn(0x7fd79007d160 legacy=0x7fd790099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd79009f910 con 0x7fd77400ad40 2020-01-26T15:28:13.648 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd7740041e0 con 0x7fd774004fb0 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79009ee00 con 0x7fd774003d40 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781511397 0 0) 0x7fd7740041e0 con 0x7fd774004fb0 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77400e990 con 0x7fd774004fb0 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258059296 0 0) 0x7fd79009f910 con 0x7fd77400ad40 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7740041e0 con 0x7fd77400ad40 2020-01-26T15:28:13.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 -- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6791/0 conn(0x7fd774004fb0 legacy=0x7fd774003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 -- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6790/0 conn(0x7fd77400ad40 legacy=0x7fd77400d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790122e50 con 0x7fd774003d40 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79009a200 con 0x7fd774003d40 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7900247b0 con 0x7fd774003d40 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd77800cb10 con 0x7fd774003d40 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800cd10 con 0x7fd774003d40 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd77800f400 con 0x7fd774003d40 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd768003360 con 0x7fd774003d40 2020-01-26T15:28:13.651 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.642+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.646+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fd778005520 con 0x7fd774003d40 2020-01-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.646+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.646+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fd7780521d0 con 0x7fd774003d40 2020-01-26T15:28:13.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.650+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.650+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fd778038540 con 0x7fd774003d40 2020-01-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd7680036b0 con 0x7fd774003d40 2020-01-26T15:28:13.807 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd787fff700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd7877fe700 1 -- 172.21.15.129:0/315931786 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fd77800f710 con 0x7fd774003d40 2020-01-26T15:28:13.808 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 >> v1:172.21.15.129:6800/16899 conn(0x7fd7740487f0 legacy=0x7fd77404ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.809 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 msgr2=0x7fd77400a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 --2- 172.21.15.129:0/315931786 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd774003d40 0x7fd77400a7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fd778001660 tx=0x7fd7780157c0).stop 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd794c71700 1 -- 172.21.15.129:0/315931786 reap_dead start 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 shutdown_connections 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 >> 172.21.15.129:0/315931786 conn(0x7fd790098e10 msgr2=0x7fd790122390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 shutdown_connections 2020-01-26T15:28:13.810 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:13.810+0000 7fd78f59e700 1 -- 172.21.15.129:0/315931786 wait complete. 2020-01-26T15:28:13.820 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:16.822 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:16.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 Processor -- start 2020-01-26T15:28:16.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 -- start start 2020-01-26T15:28:16.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 0x7f4e4805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e48098000 con 0x7f4e480a6870 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4805e050 con 0x7f4e48149040 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480a6ca0 con 0x7f4e4805edd0 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4cab5700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 0x7f4e4805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4cab5700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 0x7f4e4805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e47fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f4e480a6870 0x7f4e4807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49700/0 (socket says 172.21.15.129:49700) 2020-01-26T15:28:16.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e47fff700 1 -- 172.21.15.129:0/1132555446 learned_addr learned my addr 172.21.15.129:0/1132555446 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617938544 0 0) 0x7f4e4805e050 con 0x7f4e48149040 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e34003230 con 0x7f4e48149040 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199365559 0 0) 0x7f4e48098000 con 0x7f4e480a6870 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4805e050 con 0x7f4e480a6870 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1260376390 0 0) 0x7f4e34003230 con 0x7f4e48149040 2020-01-26T15:28:16.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 msgr2=0x7f4e4805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:16.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 --2- 172.21.15.129:0/1132555446 >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 0x7f4e4805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:16.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 >> v1:172.21.15.129:6790/0 conn(0x7f4e480a6870 legacy=0x7f4e4807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:16.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4814ecb0 con 0x7f4e48149040 2020-01-26T15:28:16.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4e400019c0 con 0x7f4e48149040 2020-01-26T15:28:16.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e40001c90 con 0x7f4e48149040 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e477fe700 1 -- 172.21.15.129:0/1132555446 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4e40002240 con 0x7f4e48149040 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.942+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/1132555446 >> v1:172.21.15.129:6791/0 conn(0x7f4e48149040 legacy=0x7f4e4814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/1132555446 shutdown_connections 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 --2- 172.21.15.129:0/1132555446 >> v2:172.21.15.129:6790/0 conn(0x7f4e4805edd0 0x7f4e4805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/1132555446 >> 172.21.15.129:0/1132555446 conn(0x7f4e48098e70 msgr2=0x7f4e480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/1132555446 shutdown_connections 2020-01-26T15:28:16.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/1132555446 wait complete. 2020-01-26T15:28:16.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 Processor -- start 2020-01-26T15:28:16.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- start start 2020-01-26T15:28:16.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 0x7f4e48131170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:16.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e48121a80 con 0x7f4e480a2350 2020-01-26T15:28:16.950 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4807c1d0 con 0x7f4e481316c0 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4d2b6700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480a4fa0 con 0x7f4e4809fb20 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4cab5700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f4e480a2350 0x7f4e4809f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49704/0 (socket says 172.21.15.129:49704) 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e4cab5700 1 -- 172.21.15.129:0/4081384898 learned_addr learned my addr 172.21.15.129:0/4081384898 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e47fff700 -1 --2- 172.21.15.129:0/4081384898 >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 0x7f4e48131170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.946+0000 7f4e47fff700 1 --2- 172.21.15.129:0/4081384898 >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 0x7f4e48131170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:16.951 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267750209 0 0) 0x7f4e4807c1d0 con 0x7f4e481316c0 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e2c003230 con 0x7f4e481316c0 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905681533 0 0) 0x7f4e48121a80 con 0x7f4e480a2350 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4807c1d0 con 0x7f4e480a2350 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3128950560 0 0) 0x7f4e2c003230 con 0x7f4e481316c0 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e48121a80 con 0x7f4e481316c0 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2620728700 0 0) 0x7f4e4807c1d0 con 0x7f4e480a2350 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e2c003230 con 0x7f4e480a2350 2020-01-26T15:28:16.952 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4e40001e40 con 0x7f4e481316c0 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4e380026c0 con 0x7f4e480a2350 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3823995268 0 0) 0x7f4e2c003230 con 0x7f4e480a2350 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 msgr2=0x7f4e48131170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 --2- 172.21.15.129:0/4081384898 >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 0x7f4e48131170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 >> v1:172.21.15.129:6791/0 conn(0x7f4e481316c0 legacy=0x7f4e4807b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:16.953 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4807c400 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4807c6d0 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e48139800 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e38000e90 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f4e380012b0 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e20003360 con 0x7f4e480a2350 2020-01-26T15:28:16.954 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f4e38001530 con 0x7f4e480a2350 2020-01-26T15:28:16.955 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.950+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f4e3804b9d0 con 0x7f4e480a2350 2020-01-26T15:28:16.955 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:16.958+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f4e38030ed0 con 0x7f4e480a2350 2020-01-26T15:28:17.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e200037d0 con 0x7f4e480a2350 2020-01-26T15:28:17.111 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e457fa700 1 -- 172.21.15.129:0/4081384898 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f4e3804a620 con 0x7f4e480a2350 2020-01-26T15:28:17.111 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:17.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 >> v1:172.21.15.129:6800/16899 conn(0x7f4e2c03e500 legacy=0x7f4e2c040a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:17.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 >> v1:172.21.15.129:6790/0 conn(0x7f4e480a2350 legacy=0x7f4e4809f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:17.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 shutdown_connections 2020-01-26T15:28:17.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 --2- 172.21.15.129:0/4081384898 >> v2:172.21.15.129:6791/0 conn(0x7f4e4809fb20 0x7f4e48131170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:17.113 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 >> 172.21.15.129:0/4081384898 conn(0x7f4e4805ef00 msgr2=0x7f4e4807ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:17.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 shutdown_connections 2020-01-26T15:28:17.114 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:17.114+0000 7f4e4d2b6700 1 -- 172.21.15.129:0/4081384898 wait complete. 2020-01-26T15:28:17.124 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:20.125 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:20.244 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 Processor -- start 2020-01-26T15:28:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 -- start start 2020-01-26T15:28:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 0x7fbde814c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde805ea20 con 0x7fbde805edd0 2020-01-26T15:28:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde8098000 con 0x7fbde805e5f0 2020-01-26T15:28:20.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde7fff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbde805e050 con 0x7fbde80a6870 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde77fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fbde805edd0 0x7fbde807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41414/0 (socket says 172.21.15.129:41414) 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde77fe700 1 -- 172.21.15.129:0/3414954760 learned_addr learned my addr 172.21.15.129:0/3414954760 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbded435700 -1 --2- 172.21.15.129:0/3414954760 >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 0x7fbde814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbded435700 1 --2- 172.21.15.129:0/3414954760 >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 0x7fbde814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665667221 0 0) 0x7fbde805ea20 con 0x7fbde805edd0 2020-01-26T15:28:20.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd0003230 con 0x7fbde805edd0 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878936026 0 0) 0x7fbde8098000 con 0x7fbde805e5f0 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde805ea20 con 0x7fbde805e5f0 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2911940040 0 0) 0x7fbde805ea20 con 0x7fbde805e5f0 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 msgr2=0x7fbde814c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 --2- 172.21.15.129:0/3414954760 >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 0x7fbde814c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:20.247 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 >> v1:172.21.15.129:6789/0 conn(0x7fbde805edd0 legacy=0x7fbde807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80a6ca0 con 0x7fbde805e5f0 2020-01-26T15:28:20.248 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.242+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbddc0016f0 con 0x7fbde805e5f0 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbddc0019c0 con 0x7fbde805e5f0 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde67fc700 1 -- 172.21.15.129:0/3414954760 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbddc001e20 con 0x7fbde805e5f0 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 -- 172.21.15.129:0/3414954760 >> v1:172.21.15.129:6791/0 conn(0x7fbde805e5f0 legacy=0x7fbde8149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 -- 172.21.15.129:0/3414954760 shutdown_connections 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 --2- 172.21.15.129:0/3414954760 >> v2:172.21.15.129:6791/0 conn(0x7fbde80a6870 0x7fbde814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:20.249 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 -- 172.21.15.129:0/3414954760 >> 172.21.15.129:0/3414954760 conn(0x7fbde8098e70 msgr2=0x7fbde80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:20.250 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 -- 172.21.15.129:0/3414954760 shutdown_connections 2020-01-26T15:28:20.250 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 -- 172.21.15.129:0/3414954760 wait complete. 2020-01-26T15:28:20.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.246+0000 7fbde7fff700 1 Processor -- start 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- start start 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 0x7fbde807a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde809e770 con 0x7fbde807af10 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde80a1510 con 0x7fbde809e340 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fbde80a5240 con 0x7fbde80a10e0 2020-01-26T15:28:20.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbded435700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fbde807af10 0x7fbde813aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49722/0 (socket says 172.21.15.129:49722) 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbded435700 1 -- 172.21.15.129:0/2966166273 learned_addr learned my addr 172.21.15.129:0/2966166273 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde6ffd700 -1 --2- 172.21.15.129:0/2966166273 >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 0x7fbde807a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde6ffd700 1 --2- 172.21.15.129:0/2966166273 >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 0x7fbde807a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602750470 0 0) 0x7fbde809e770 con 0x7fbde807af10 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc8003230 con 0x7fbde807af10 2020-01-26T15:28:20.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719227760 0 0) 0x7fbde80a1510 con 0x7fbde809e340 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde809e770 con 0x7fbde809e340 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4282508547 0 0) 0x7fbdc8003230 con 0x7fbde807af10 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbde80a1510 con 0x7fbde807af10 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbdd80026f0 con 0x7fbde807af10 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 355881618 0 0) 0x7fbde809e770 con 0x7fbde809e340 2020-01-26T15:28:20.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbdc8003230 con 0x7fbde809e340 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbde0001b70 con 0x7fbde809e340 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 349378408 0 0) 0x7fbde80a1510 con 0x7fbde807af10 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 msgr2=0x7fbde807a9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 --2- 172.21.15.129:0/2966166273 >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 0x7fbde807a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 >> v1:172.21.15.129:6791/0 conn(0x7fbde809e340 legacy=0x7fbde8099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:20.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80a4690 con 0x7fbde807af10 2020-01-26T15:28:20.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde807b340 con 0x7fbde807af10 2020-01-26T15:28:20.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbdd8000e90 con 0x7fbde807af10 2020-01-26T15:28:20.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde813c250 con 0x7fbde807af10 2020-01-26T15:28:20.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.250+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbdd80012b0 con 0x7fbde807af10 2020-01-26T15:28:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.254+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fbdd80014b0 con 0x7fbde807af10 2020-01-26T15:28:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.254+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde8056600 con 0x7fbde807af10 2020-01-26T15:28:20.259 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.254+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fbdd804ba80 con 0x7fbde807af10 2020-01-26T15:28:20.260 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.258+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fbdd8030f40 con 0x7fbde807af10 2020-01-26T15:28:20.410 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.410+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbde80a38e0 con 0x7fbde807af10 2020-01-26T15:28:20.410 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbdcffff700 1 -- 172.21.15.129:0/2966166273 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fbdd804a690 con 0x7fbde807af10 2020-01-26T15:28:20.411 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:20.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 >> v1:172.21.15.129:6800/16899 conn(0x7fbdc803e530 legacy=0x7fbdc8040a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:20.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 >> v1:172.21.15.129:6790/0 conn(0x7fbde807af10 legacy=0x7fbde813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 shutdown_connections 2020-01-26T15:28:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 --2- 172.21.15.129:0/2966166273 >> v2:172.21.15.129:6790/0 conn(0x7fbde80a10e0 0x7fbde807a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 >> 172.21.15.129:0/2966166273 conn(0x7fbde807e840 msgr2=0x7fbde80979b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 shutdown_connections 2020-01-26T15:28:20.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:20.414+0000 7fbde7fff700 1 -- 172.21.15.129:0/2966166273 wait complete. 2020-01-26T15:28:20.431 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:23.432 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 Processor -- start 2020-01-26T15:28:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 -- start start 2020-01-26T15:28:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 0x7fc46805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:23.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc468098000 con 0x7fc468149040 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46805e050 con 0x7fc4680a6870 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.550+0000 7fc46db80700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc4680a6ca0 con 0x7fc46805edd0 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46ede2700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc468149040 0x7fc46814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41432/0 (socket says 172.21.15.129:41432) 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46ede2700 1 -- 172.21.15.129:0/4111964473 learned_addr learned my addr 172.21.15.129:0/4111964473 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46d37f700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 0x7fc46805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46d37f700 1 --2- 172.21.15.129:0/4111964473 >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 0x7fc46805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:23.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633376226 0 0) 0x7fc46805e050 con 0x7fc4680a6870 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc454003230 con 0x7fc4680a6870 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275029568 0 0) 0x7fc468098000 con 0x7fc468149040 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46805e050 con 0x7fc468149040 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3136130983 0 0) 0x7fc454003230 con 0x7fc4680a6870 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 msgr2=0x7fc46805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 --2- 172.21.15.129:0/4111964473 >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 0x7fc46805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 >> v1:172.21.15.129:6789/0 conn(0x7fc468149040 legacy=0x7fc46814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.556 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46814ecb0 con 0x7fc4680a6870 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc458001710 con 0x7fc4680a6870 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc4580019e0 con 0x7fc4680a6870 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc45ffff700 1 -- 172.21.15.129:0/4111964473 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc458001ec0 con 0x7fc4680a6870 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 -- 172.21.15.129:0/4111964473 >> v1:172.21.15.129:6790/0 conn(0x7fc4680a6870 legacy=0x7fc46807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 -- 172.21.15.129:0/4111964473 shutdown_connections 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 --2- 172.21.15.129:0/4111964473 >> v2:172.21.15.129:6791/0 conn(0x7fc46805edd0 0x7fc46805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:23.557 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 -- 172.21.15.129:0/4111964473 >> 172.21.15.129:0/4111964473 conn(0x7fc468098e70 msgr2=0x7fc4680a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:23.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 -- 172.21.15.129:0/4111964473 shutdown_connections 2020-01-26T15:28:23.558 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.554+0000 7fc46db80700 1 -- 172.21.15.129:0/4111964473 wait complete. 2020-01-26T15:28:23.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 Processor -- start 2020-01-26T15:28:23.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 -- start start 2020-01-26T15:28:23.562 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc468099a00 0x7fc468099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:23.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46809f990 con 0x7fc468129bd0 2020-01-26T15:28:23.563 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46809a4d0 con 0x7fc46812c890 2020-01-26T15:28:23.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46db80700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc46809eeb0 con 0x7fc468099a00 2020-01-26T15:28:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46cb7e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fc46812c890 0x7fc4680a0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47352/0 (socket says 172.21.15.129:47352) 2020-01-26T15:28:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46ede2700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc468129bd0 0x7fc4681372a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41438/0 (socket says 172.21.15.129:41438) 2020-01-26T15:28:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46cb7e700 1 -- 172.21.15.129:0/3491137822 learned_addr learned my addr 172.21.15.129:0/3491137822 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46d37f700 -1 --2- 172.21.15.129:0/3491137822 >> v2:172.21.15.129:6791/0 conn(0x7fc468099a00 0x7fc468099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:23.569 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc46d37f700 1 --2- 172.21.15.129:0/3491137822 >> v2:172.21.15.129:6791/0 conn(0x7fc468099a00 0x7fc468099f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625733721 0 0) 0x7fc46809a4d0 con 0x7fc46812c890 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc448003230 con 0x7fc46812c890 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112715156 0 0) 0x7fc46809f990 con 0x7fc468129bd0 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46809a4d0 con 0x7fc468129bd0 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2184679422 0 0) 0x7fc46809a4d0 con 0x7fc468129bd0 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc46809f990 con 0x7fc468129bd0 2020-01-26T15:28:23.570 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc460001c70 con 0x7fc468129bd0 2020-01-26T15:28:23.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 >> v2:172.21.15.129:6791/0 conn(0x7fc468099a00 msgr2=0x7fc468099f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:23.571 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 --2- 172.21.15.129:0/3491137822 >> v2:172.21.15.129:6791/0 conn(0x7fc468099a00 0x7fc468099f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:23.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 >> v1:172.21.15.129:6791/0 conn(0x7fc46812c890 legacy=0x7fc4680a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.572 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 >> v1:172.21.15.129:6789/0 conn(0x7fc468129bd0 legacy=0x7fc4681372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.558+0000 7fc45dffb700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc46809a4d0 con 0x7fc448004c90 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc4480116e0 con 0x7fc44800ca00 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46809eeb0 con 0x7fc448005150 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325587834 0 0) 0x7fc46809a4d0 con 0x7fc448004c90 2020-01-26T15:28:23.573 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc448011910 con 0x7fc448004c90 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059087154 0 0) 0x7fc4480116e0 con 0x7fc44800ca00 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46809a4d0 con 0x7fc44800ca00 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 -- 172.21.15.129:0/3491137822 >> v1:172.21.15.129:6791/0 conn(0x7fc44800ca00 legacy=0x7fc44800ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 -- 172.21.15.129:0/3491137822 >> v1:172.21.15.129:6790/0 conn(0x7fc448004c90 legacy=0x7fc448003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46812a000 con 0x7fc448005150 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46812a2d0 con 0x7fc448005150 2020-01-26T15:28:23.574 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46812c890 con 0x7fc448005150 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc458010320 con 0x7fc448005150 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.575 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458010520 con 0x7fc448005150 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc45800c9a0 con 0x7fc448005150 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc45800cbf0 con 0x7fc448005150 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc440003360 con 0x7fc448005150 2020-01-26T15:28:23.576 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.562+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc45804cf30 con 0x7fc448005150 2020-01-26T15:28:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.570+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.577 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.570+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc4580330c0 con 0x7fc448005150 2020-01-26T15:28:23.721 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.722+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc440003790 con 0x7fc448005150 2020-01-26T15:28:23.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.722+0000 7fc46cb7e700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:23.722 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.722+0000 7fc45dffb700 1 -- 172.21.15.129:0/3491137822 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc458033320 con 0x7fc448005150 2020-01-26T15:28:23.722 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 >> v1:172.21.15.129:6800/16899 conn(0x7fc44804a7c0 legacy=0x7fc44804ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 msgr2=0x7fc448003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 --2- 172.21.15.129:0/3491137822 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc448005150 0x7fc448003de0 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7fc4681202a0 tx=0x7fc45800c770).stop 2020-01-26T15:28:23.723 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46ede2700 1 -- 172.21.15.129:0/3491137822 reap_dead start 2020-01-26T15:28:23.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 shutdown_connections 2020-01-26T15:28:23.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 >> 172.21.15.129:0/3491137822 conn(0x7fc46805efe0 msgr2=0x7fc468122390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:23.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 shutdown_connections 2020-01-26T15:28:23.724 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:23.726+0000 7fc46db80700 1 -- 172.21.15.129:0/3491137822 wait complete. 2020-01-26T15:28:23.735 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:26.736 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:26.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 Processor -- start 2020-01-26T15:28:26.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 -- start start 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 0x7fee4c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0a5b80 con 0x7fee4c1495c0 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c080440 con 0x7fee4c0a5750 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee51b86700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0a43f0 con 0x7fee4c146c30 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee4bfff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fee4c0a5750 0x7fee4c0a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47364/0 (socket says 172.21.15.129:47364) 2020-01-26T15:28:26.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee4bfff700 1 -- 172.21.15.129:0/2335003741 learned_addr learned my addr 172.21.15.129:0/2335003741 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee4b7fe700 -1 --2- 172.21.15.129:0/2335003741 >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 0x7fee4c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.858+0000 7fee4b7fe700 1 --2- 172.21.15.129:0/2335003741 >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 0x7fee4c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269367846 0 0) 0x7fee4c0a5b80 con 0x7fee4c1495c0 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee34003230 con 0x7fee4c1495c0 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691225578 0 0) 0x7fee4c080440 con 0x7fee4c0a5750 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c0a5b80 con 0x7fee4c0a5750 2020-01-26T15:28:26.862 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1104457725 0 0) 0x7fee34003230 con 0x7fee4c1495c0 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 msgr2=0x7fee4c149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 --2- 172.21.15.129:0/2335003741 >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 0x7fee4c149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 >> v1:172.21.15.129:6791/0 conn(0x7fee4c0a5750 legacy=0x7fee4c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0a4e00 con 0x7fee4c1495c0 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fee44001a90 con 0x7fee4c1495c0 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fee44001d60 con 0x7fee4c1495c0 2020-01-26T15:28:26.863 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee4affd700 1 -- 172.21.15.129:0/2335003741 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fee44002240 con 0x7fee4c1495c0 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 -- 172.21.15.129:0/2335003741 >> v1:172.21.15.129:6790/0 conn(0x7fee4c1495c0 legacy=0x7fee4c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 -- 172.21.15.129:0/2335003741 shutdown_connections 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 --2- 172.21.15.129:0/2335003741 >> v2:172.21.15.129:6791/0 conn(0x7fee4c146c30 0x7fee4c149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 -- 172.21.15.129:0/2335003741 >> 172.21.15.129:0/2335003741 conn(0x7fee4c05e050 msgr2=0x7fee4c098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 -- 172.21.15.129:0/2335003741 shutdown_connections 2020-01-26T15:28:26.864 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.862+0000 7fee51b86700 1 -- 172.21.15.129:0/2335003741 wait complete. 2020-01-26T15:28:26.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 Processor -- start 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- start start 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 0x7fee4c12ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 0x7fee4c1373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c121430 con 0x7fee4c0910a0 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c120560 con 0x7fee4c12c9d0 2020-01-26T15:28:26.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c121870 con 0x7fee4c12d350 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee4bfff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fee4c0910a0 0x7fee4c08f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47370/0 (socket says 172.21.15.129:47370) 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee4bfff700 1 -- 172.21.15.129:0/1574651781 learned_addr learned my addr 172.21.15.129:0/1574651781 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee4b7fe700 -1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 0x7fee4c12ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee4b7fe700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 0x7fee4c12ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee50924700 -1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 0x7fee4c1373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee50924700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 0x7fee4c1373e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:26.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663672642 0 0) 0x7fee4c121430 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee2c003230 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 642926859 0 0) 0x7fee2c003230 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fee4c121430 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fee3c001850 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 173684638 0 0) 0x7fee4c121430 con 0x7fee4c0910a0 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 msgr2=0x7fee4c1373e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:26.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 0x7fee4c1373e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 msgr2=0x7fee4c12ce00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 0x7fee4c12ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c12d780 con 0x7fee4c0910a0 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c08fef0 con 0x7fee4c0910a0 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c137930 con 0x7fee4c0910a0 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fee3c0048a0 con 0x7fee4c0910a0 2020-01-26T15:28:26.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.866+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fee3c004cc0 con 0x7fee4c0910a0 2020-01-26T15:28:26.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.870+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fee3c004ec0 con 0x7fee4c0910a0 2020-01-26T15:28:26.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.870+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c056600 con 0x7fee4c0910a0 2020-01-26T15:28:26.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.870+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7fee3c04bba0 con 0x7fee4c0910a0 2020-01-26T15:28:26.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:26.874+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fee3c031060 con 0x7fee4c0910a0 2020-01-26T15:28:27.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.038+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fee4c0a4760 con 0x7fee4c0910a0 2020-01-26T15:28:27.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.038+0000 7fee48ff9700 1 -- 172.21.15.129:0/1574651781 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fee3c0051d0 con 0x7fee4c0910a0 2020-01-26T15:28:27.037 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:27.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 >> v1:172.21.15.129:6800/16899 conn(0x7fee2c03e0f0 legacy=0x7fee2c040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:27.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 >> v1:172.21.15.129:6791/0 conn(0x7fee4c0910a0 legacy=0x7fee4c08f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 shutdown_connections 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6791/0 conn(0x7fee4c12d350 0x7fee4c1373e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 --2- 172.21.15.129:0/1574651781 >> v2:172.21.15.129:6790/0 conn(0x7fee4c12c9d0 0x7fee4c12ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 >> 172.21.15.129:0/1574651781 conn(0x7fee4c05f5f0 msgr2=0x7fee4c0a0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 shutdown_connections 2020-01-26T15:28:27.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:27.042+0000 7fee51b86700 1 -- 172.21.15.129:0/1574651781 wait complete. 2020-01-26T15:28:27.050 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:30.051 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 Processor -- start 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- start start 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 0x7f10ec05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 0x7f10ec14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec098000 con 0x7f10ec0a6870 2020-01-26T15:28:30.170 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec05e050 con 0x7f10ec149040 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec0a6ca0 con 0x7f10ec05edd0 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10ea59c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f10ec0a6870 0x7f10ec07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49764/0 (socket says 172.21.15.129:49764) 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10ea59c700 1 -- 172.21.15.129:0/3547786856 learned_addr learned my addr 172.21.15.129:0/3547786856 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10f0e9a700 -1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 0x7f10ec14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10ead9d700 -1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 0x7f10ec05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10f0e9a700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 0x7f10ec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:30.171 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10ead9d700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 0x7f10ec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126099376 0 0) 0x7f10ec098000 con 0x7f10ec0a6870 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d8003230 con 0x7f10ec0a6870 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1425636352 0 0) 0x7f10d8003230 con 0x7f10ec0a6870 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 msgr2=0x7f10ec05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 0x7f10ec05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 msgr2=0x7f10ec14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 0x7f10ec14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:30.172 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec14c9e0 con 0x7f10ec0a6870 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f10dc001710 con 0x7f10ec0a6870 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f10dc001aa0 con 0x7f10ec0a6870 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10e9d9b700 1 -- 172.21.15.129:0/3547786856 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f10dc004760 con 0x7f10ec0a6870 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- 172.21.15.129:0/3547786856 >> v1:172.21.15.129:6790/0 conn(0x7f10ec0a6870 legacy=0x7f10ec07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- 172.21.15.129:0/3547786856 shutdown_connections 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6790/0 conn(0x7f10ec149040 0x7f10ec14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:30.173 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 --2- 172.21.15.129:0/3547786856 >> v2:172.21.15.129:6791/0 conn(0x7f10ec05edd0 0x7f10ec05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- 172.21.15.129:0/3547786856 >> 172.21.15.129:0/3547786856 conn(0x7f10ec098e70 msgr2=0x7f10ec0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- 172.21.15.129:0/3547786856 shutdown_connections 2020-01-26T15:28:30.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.170+0000 7f10eb59e700 1 -- 172.21.15.129:0/3547786856 wait complete. 2020-01-26T15:28:30.184 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10eb59e700 1 Processor -- start 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10eb59e700 1 -- start start 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10eb59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec11f4d0 con 0x7f10ec09d870 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10eb59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec05be40 con 0x7f10ec11e3b0 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10eb59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec11dfc0 con 0x7f10ec11f0a0 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10ea59c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f10ec11e3b0 0x7f10ec09f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49768/0 (socket says 172.21.15.129:49768) 2020-01-26T15:28:30.185 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10ead9d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f10ec09d870 0x7f10ec09ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41468/0 (socket says 172.21.15.129:41468) 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10ea59c700 1 -- 172.21.15.129:0/681823480 learned_addr learned my addr 172.21.15.129:0/681823480 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10f0e9a700 1 --1- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6791/0 conn(0x7f10ec11f0a0 0x7f10ec1394a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47388/0 (socket says 172.21.15.129:47388) 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902526282 0 0) 0x7f10ec05be40 con 0x7f10ec11e3b0 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d0003230 con 0x7f10ec11e3b0 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055097277 0 0) 0x7f10ec11f4d0 con 0x7f10ec09d870 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec05be40 con 0x7f10ec09d870 2020-01-26T15:28:30.186 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865662078 0 0) 0x7f10ec11dfc0 con 0x7f10ec11f0a0 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec11f4d0 con 0x7f10ec11f0a0 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1697140498 0 0) 0x7f10ec05be40 con 0x7f10ec09d870 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10ec11dfc0 con 0x7f10ec09d870 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f10d4001660 con 0x7f10ec09d870 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6791/0 conn(0x7f10ec11f0a0 legacy=0x7f10ec1394a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6790/0 conn(0x7f10ec11e3b0 legacy=0x7f10ec09f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.187 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6789/0 conn(0x7f10ec09d870 legacy=0x7f10ec09ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f10ec11f4d0 con 0x7f10d0004ef0 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f10ec05be40 con 0x7f10d000ad40 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.174+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0004230 con 0x7f10d0003d40 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533413113 0 0) 0x7f10ec05be40 con 0x7f10d000ad40 2020-01-26T15:28:30.188 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d000e990 con 0x7f10d000ad40 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871347928 0 0) 0x7f10ec11f4d0 con 0x7f10d0004ef0 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10ec05be40 con 0x7f10d0004ef0 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2423610336 0 0) 0x7f10d000e990 con 0x7f10d000ad40 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f10ec11f4d0 con 0x7f10d000ad40 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f10e40023f0 con 0x7f10d000ad40 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6791/0 conn(0x7f10d000ad40 legacy=0x7f10d000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.189 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6790/0 conn(0x7f10d0004ef0 legacy=0x7f10d0003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0a4ae0 con 0x7f10d0003d40 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec11f0a0 con 0x7f10d0003d40 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec11e3b0 con 0x7f10d0003d40 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:30.190 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f10dc007180 con 0x7f10d0003d40 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc007380 con 0x7f10d0003d40 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f10dc007720 con 0x7f10d0003d40 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.191 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4003360 con 0x7f10d0003d40 2020-01-26T15:28:30.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f10dc007970 con 0x7f10d0003d40 2020-01-26T15:28:30.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.178+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f10dc04cfc0 con 0x7f10d0003d40 2020-01-26T15:28:30.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.186+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.192 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.186+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f10dc007c80 con 0x7f10d0003d40 2020-01-26T15:28:30.341 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.342+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f10c4003790 con 0x7f10d0003d40 2020-01-26T15:28:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10ea59c700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:30.342 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10e37fe700 1 -- 172.21.15.129:0/681823480 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f10dc030dd0 con 0x7f10d0003d40 2020-01-26T15:28:30.342 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:30.343 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 >> v1:172.21.15.129:6800/16899 conn(0x7f10d0048650 legacy=0x7f10d004ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 msgr2=0x7f10d000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 --2- 172.21.15.129:0/681823480 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f10d0003d40 0x7f10d000a7f0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f10dc001b60 tx=0x7f10dc010cf0).stop 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10f0e9a700 1 -- 172.21.15.129:0/681823480 reap_dead start 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 shutdown_connections 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 >> 172.21.15.129:0/681823480 conn(0x7f10ec097e00 msgr2=0x7f10ec07f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 shutdown_connections 2020-01-26T15:28:30.344 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:30.346+0000 7f10eb59e700 1 -- 172.21.15.129:0/681823480 wait complete. 2020-01-26T15:28:30.355 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:33.356 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:33.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 Processor -- start 2020-01-26T15:28:33.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 -- start start 2020-01-26T15:28:33.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 0x7ffa2005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:33.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa20098000 con 0x7ffa20149040 2020-01-26T15:28:33.489 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2005e050 con 0x7ffa200a6870 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1ffff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200a6ca0 con 0x7ffa2005edd0 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa256d4700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ffa20149040 0x7ffa2014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49782/0 (socket says 172.21.15.129:49782) 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa256d4700 1 -- 172.21.15.129:0/3849881140 learned_addr learned my addr 172.21.15.129:0/3849881140 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1f7fe700 -1 --2- 172.21.15.129:0/3849881140 >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 0x7ffa2005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.478+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/3849881140 >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 0x7ffa2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401305991 0 0) 0x7ffa20098000 con 0x7ffa20149040 2020-01-26T15:28:33.490 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa08003230 con 0x7ffa20149040 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372790385 0 0) 0x7ffa2005e050 con 0x7ffa200a6870 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa20098000 con 0x7ffa200a6870 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 855244963 0 0) 0x7ffa08003230 con 0x7ffa20149040 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 msgr2=0x7ffa2005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 --2- 172.21.15.129:0/3849881140 >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 0x7ffa2005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 >> v1:172.21.15.129:6791/0 conn(0x7ffa200a6870 legacy=0x7ffa2007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2014ecb0 con 0x7ffa20149040 2020-01-26T15:28:33.491 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ffa18001710 con 0x7ffa20149040 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffa180019e0 con 0x7ffa20149040 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1e7fc700 1 -- 172.21.15.129:0/3849881140 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ffa180045b0 con 0x7ffa20149040 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 -- 172.21.15.129:0/3849881140 >> v1:172.21.15.129:6790/0 conn(0x7ffa20149040 legacy=0x7ffa2014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 -- 172.21.15.129:0/3849881140 shutdown_connections 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 --2- 172.21.15.129:0/3849881140 >> v2:172.21.15.129:6791/0 conn(0x7ffa2005edd0 0x7ffa2005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 -- 172.21.15.129:0/3849881140 >> 172.21.15.129:0/3849881140 conn(0x7ffa20098e70 msgr2=0x7ffa200a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:33.492 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 -- 172.21.15.129:0/3849881140 shutdown_connections 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.482+0000 7ffa1ffff700 1 -- 172.21.15.129:0/3849881140 wait complete. 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1ffff700 1 Processor -- start 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1ffff700 1 -- start start 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1ffff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2009e980 con 0x7ffa2012c750 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1ffff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2011e980 con 0x7ffa20139720 2020-01-26T15:28:33.493 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1ffff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2011e1d0 con 0x7ffa2011e550 2020-01-26T15:28:33.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa256d4700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ffa20139720 0x7ffa2013bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49790/0 (socket says 172.21.15.129:49790) 2020-01-26T15:28:33.497 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa256d4700 1 -- 172.21.15.129:0/338098206 learned_addr learned my addr 172.21.15.129:0/338098206 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116340329 0 0) 0x7ffa2011e980 con 0x7ffa20139720 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa00003230 con 0x7ffa20139720 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420915201 0 0) 0x7ffa2011e1d0 con 0x7ffa2011e550 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2011e980 con 0x7ffa2011e550 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963260991 0 0) 0x7ffa2009e980 con 0x7ffa2012c750 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2011e1d0 con 0x7ffa2012c750 2020-01-26T15:28:33.498 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3310979713 0 0) 0x7ffa00003230 con 0x7ffa20139720 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa2009e980 con 0x7ffa20139720 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1679381110 0 0) 0x7ffa2011e980 con 0x7ffa2011e550 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa00003230 con 0x7ffa2011e550 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2138515830 0 0) 0x7ffa2011e1d0 con 0x7ffa2012c750 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa2011e980 con 0x7ffa2012c750 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ffa18001420 con 0x7ffa20139720 2020-01-26T15:28:33.499 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ffa10001960 con 0x7ffa2011e550 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ffa14001790 con 0x7ffa2012c750 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6791/0 conn(0x7ffa2011e550 legacy=0x7ffa2011fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6790/0 conn(0x7ffa20139720 legacy=0x7ffa2013bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6789/0 conn(0x7ffa2012c750 legacy=0x7ffa2012cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ffa2011e1d0 con 0x7ffa00004f20 2020-01-26T15:28:33.500 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ffa0000fc80 con 0x7ffa0000aff0 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00010f80 con 0x7ffa000045a0 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.486+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308861016 0 0) 0x7ffa0000fc80 con 0x7ffa0000aff0 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0000ec70 con 0x7ffa0000aff0 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785162173 0 0) 0x7ffa2011e1d0 con 0x7ffa00004f20 2020-01-26T15:28:33.501 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0000fc80 con 0x7ffa00004f20 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1394693617 0 0) 0x7ffa0000ec70 con 0x7ffa0000aff0 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6791/0 conn(0x7ffa0000aff0 legacy=0x7ffa0000d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6790/0 conn(0x7ffa00004f20 legacy=0x7ffa000097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7ffa2007d6e0 con 0x7ffa000045a0 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2011f190 con 0x7ffa000045a0 2020-01-26T15:28:33.502 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2007cf10 con 0x7ffa000045a0 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ffa18004c10 con 0x7ffa000045a0 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.503 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1000cd00 con 0x7ffa000045a0 2020-01-26T15:28:33.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8003360 con 0x7ffa000045a0 2020-01-26T15:28:33.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ffa10005ae0 con 0x7ffa000045a0 2020-01-26T15:28:33.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.504 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.490+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ffa1004cfe0 con 0x7ffa000045a0 2020-01-26T15:28:33.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.494+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.505 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.494+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ffa10033390 con 0x7ffa000045a0 2020-01-26T15:28:33.649 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff9f8003790 con 0x7ffa000045a0 2020-01-26T15:28:33.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1f7fe700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:33.650 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa07fff700 1 -- 172.21.15.129:0/338098206 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ffa10030690 con 0x7ffa000045a0 2020-01-26T15:28:33.651 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 >> v1:172.21.15.129:6800/16899 conn(0x7ffa00048e40 legacy=0x7ffa0004b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 msgr2=0x7ffa000049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 --2- 172.21.15.129:0/338098206 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7ffa000045a0 0x7ffa000049d0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ffa18004720 tx=0x7ffa100115c0).stop 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa256d4700 1 -- 172.21.15.129:0/338098206 reap_dead start 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 shutdown_connections 2020-01-26T15:28:33.652 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 >> 172.21.15.129:0/338098206 conn(0x7ffa20097e00 msgr2=0x7ffa2007f140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:33.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 shutdown_connections 2020-01-26T15:28:33.653 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:33.654+0000 7ffa1ffff700 1 -- 172.21.15.129:0/338098206 wait complete. 2020-01-26T15:28:33.664 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:36.666 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:36.787 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 Processor -- start 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 -- start start 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 0x7f3da00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da00a6dc0 con 0x7f3da0149040 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da005ea20 con 0x7f3da005edd0 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6f05700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f3da0098000 con 0x7f3da005e5f0 2020-01-26T15:28:36.788 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6704700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f3da005edd0 0x7f3da007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47418/0 (socket says 172.21.15.129:47418) 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da6704700 1 -- 172.21.15.129:0/51794536 learned_addr learned my addr 172.21.15.129:0/51794536 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5f03700 -1 --2- 172.21.15.129:0/51794536 >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 0x7f3da00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5f03700 1 --2- 172.21.15.129:0/51794536 >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 0x7f3da00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715928328 0 0) 0x7f3da005ea20 con 0x7f3da005edd0 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8c003230 con 0x7f3da005edd0 2020-01-26T15:28:36.789 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768551798 0 0) 0x7f3da00a6dc0 con 0x7f3da0149040 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da005ea20 con 0x7f3da0149040 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.786+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3783646575 0 0) 0x7f3d8c003230 con 0x7f3da005edd0 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 msgr2=0x7f3da00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 --2- 172.21.15.129:0/51794536 >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 0x7f3da00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 >> v1:172.21.15.129:6789/0 conn(0x7f3da0149040 legacy=0x7f3da014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da005e050 con 0x7f3da005edd0 2020-01-26T15:28:36.790 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3d9c001710 con 0x7f3da005edd0 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3d9c0019e0 con 0x7f3da005edd0 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da5702700 1 -- 172.21.15.129:0/51794536 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3d9c0045b0 con 0x7f3da005edd0 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- 172.21.15.129:0/51794536 >> v1:172.21.15.129:6791/0 conn(0x7f3da005edd0 legacy=0x7f3da007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- 172.21.15.129:0/51794536 shutdown_connections 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 --2- 172.21.15.129:0/51794536 >> v2:172.21.15.129:6790/0 conn(0x7f3da005e5f0 0x7f3da00a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- 172.21.15.129:0/51794536 >> 172.21.15.129:0/51794536 conn(0x7f3da0098e70 msgr2=0x7f3da00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- 172.21.15.129:0/51794536 shutdown_connections 2020-01-26T15:28:36.791 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- 172.21.15.129:0/51794536 wait complete. 2020-01-26T15:28:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 Processor -- start 2020-01-26T15:28:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- start start 2020-01-26T15:28:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3da006fd40 0x7f3da01365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:36.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da011fa20 con 0x7f3da0136b20 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da009f780 con 0x7f3da011f5f0 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.790+0000 7f3da6f05700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00a5aa0 con 0x7f3da006fd40 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da5f03700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3da006fd40 0x7f3da01365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da5f03700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f3da006fd40 0x7f3da01365d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da8167700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f3da0136b20 0x7f3da0138f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41508/0 (socket says 172.21.15.129:41508) 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da8167700 1 -- 172.21.15.129:0/2757789136 learned_addr learned my addr 172.21.15.129:0/2757789136 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:36.797 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956782481 0 0) 0x7f3da009f780 con 0x7f3da011f5f0 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d88003230 con 0x7f3da011f5f0 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427261948 0 0) 0x7f3da011fa20 con 0x7f3da0136b20 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da009f780 con 0x7f3da0136b20 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3576282421 0 0) 0x7f3d88003230 con 0x7f3da011f5f0 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3da011fa20 con 0x7f3da011f5f0 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3d9c001420 con 0x7f3da011f5f0 2020-01-26T15:28:36.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2832376400 0 0) 0x7f3da009f780 con 0x7f3da0136b20 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3d88003230 con 0x7f3da0136b20 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3d98001c70 con 0x7f3da0136b20 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 >> v2:172.21.15.129:6791/0 conn(0x7f3da006fd40 msgr2=0x7f3da01365d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 --2- 172.21.15.129:0/2757789136 >> v2:172.21.15.129:6791/0 conn(0x7f3da006fd40 0x7f3da01365d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 >> v1:172.21.15.129:6790/0 conn(0x7f3da011f5f0 legacy=0x7f3da0120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 >> v1:172.21.15.129:6789/0 conn(0x7f3da0136b20 legacy=0x7f3da0138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:36.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3da011fa20 con 0x7f3d88003ec0 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3da009f780 con 0x7f3d88003a90 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00a5aa0 con 0x7f3d88004f00 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900146754 0 0) 0x7f3da011fa20 con 0x7f3d88003ec0 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8800e810 con 0x7f3d88003ec0 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609419351 0 0) 0x7f3da009f780 con 0x7f3d88003a90 2020-01-26T15:28:36.800 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da011fa20 con 0x7f3d88003a90 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 -- 172.21.15.129:0/2757789136 >> v1:172.21.15.129:6791/0 conn(0x7f3d88003a90 legacy=0x7f3d880097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 -- 172.21.15.129:0/2757789136 >> v1:172.21.15.129:6790/0 conn(0x7f3d88003ec0 legacy=0x7f3d8800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f3da0070170 con 0x7f3d88004f00 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da006f910 con 0x7f3d88004f00 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.801 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00a0d40 con 0x7f3d88004f00 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3d9c012380 con 0x7f3d88004f00 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c001210 con 0x7f3d88004f00 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.794+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.798+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c003360 con 0x7f3d88004f00 2020-01-26T15:28:36.802 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.798+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f3d9c012580 con 0x7f3d88004f00 2020-01-26T15:28:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.798+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.798+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f3d9c04d6f0 con 0x7f3d88004f00 2020-01-26T15:28:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.802+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.803 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.802+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f3d9c0338a0 con 0x7f3d88004f00 2020-01-26T15:28:36.959 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3d7c003790 con 0x7f3d88004f00 2020-01-26T15:28:36.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da6704700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=THROTTLE_DONE pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:36.960 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3d96ffd700 1 -- 172.21.15.129:0/2757789136 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3d9c033b00 con 0x7f3d88004f00 2020-01-26T15:28:36.960 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 >> v1:172.21.15.129:6800/16899 conn(0x7f3d880484a0 legacy=0x7f3d8804a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 msgr2=0x7f3d88003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da8167700 1 -- 172.21.15.129:0/2757789136 reap_dead start 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.962+0000 7f3da6f05700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 secure :-1 s=READY pgs=210 cs=0 l=1 rx=0x7f3d9c000e90 tx=0x7f3d9c011880).stop 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.966+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 shutdown_connections 2020-01-26T15:28:36.962 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.966+0000 7f3da6f05700 1 --2- 172.21.15.129:0/2757789136 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3d88004f00 0x7f3d88003540 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:36.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.966+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 >> 172.21.15.129:0/2757789136 conn(0x7f3da005e5f0 msgr2=0x7f3da007f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:36.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.966+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 shutdown_connections 2020-01-26T15:28:36.963 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:36.966+0000 7f3da6f05700 1 -- 172.21.15.129:0/2757789136 wait complete. 2020-01-26T15:28:36.973 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:39.974 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:40.096 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.094+0000 7f9c0b59e700 1 Processor -- start 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.094+0000 7f9c0b59e700 1 -- start start 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.094+0000 7f9c0b59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 0x7f9c0c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 0x7f9c0c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c098000 con 0x7f9c0c0a6870 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c05e050 con 0x7f9c0c05edd0 2020-01-26T15:28:40.097 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0a6ca0 con 0x7f9c0c149040 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c10a3b700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 0x7f9c0c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0a59c700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f9c0c0a6870 0x7f9c0c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47442/0 (socket says 172.21.15.129:47442) 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0ad9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 0x7f9c0c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0a59c700 1 -- 172.21.15.129:0/3204338071 learned_addr learned my addr 172.21.15.129:0/3204338071 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c10a3b700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 0x7f9c0c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0ad9d700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 0x7f9c0c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:40.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769868744 0 0) 0x7f9c0c098000 con 0x7f9c0c0a6870 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf4003230 con 0x7f9c0c0a6870 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 986967605 0 0) 0x7f9bf4003230 con 0x7f9c0c0a6870 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 msgr2=0x7f9c0c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 0x7f9c0c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 msgr2=0x7f9c0c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 0x7f9c0c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c14c9e0 con 0x7f9c0c0a6870 2020-01-26T15:28:40.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9c00001710 con 0x7f9c0c0a6870 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9c00001aa0 con 0x7f9c0c0a6870 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c09d9b700 1 -- 172.21.15.129:0/3204338071 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9c00004760 con 0x7f9c0c0a6870 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- 172.21.15.129:0/3204338071 >> v1:172.21.15.129:6791/0 conn(0x7f9c0c0a6870 legacy=0x7f9c0c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- 172.21.15.129:0/3204338071 shutdown_connections 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6791/0 conn(0x7f9c0c149040 0x7f9c0c14b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 --2- 172.21.15.129:0/3204338071 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c05edd0 0x7f9c0c05e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- 172.21.15.129:0/3204338071 >> 172.21.15.129:0/3204338071 conn(0x7f9c0c098e70 msgr2=0x7f9c0c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:40.100 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- 172.21.15.129:0/3204338071 shutdown_connections 2020-01-26T15:28:40.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.098+0000 7f9c0b59e700 1 -- 172.21.15.129:0/3204338071 wait complete. 2020-01-26T15:28:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 Processor -- start 2020-01-26T15:28:40.103 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 -- start start 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 0x7f9c0c07cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c07cc90 con 0x7f9c0c07bed0 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c09e800 con 0x7f9c0c060220 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0ad9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f9c0c060220 0x7f9c0c09e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47444/0 (socket says 172.21.15.129:47444) 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0ad9d700 1 -- 172.21.15.129:0/637874702 learned_addr learned my addr 172.21.15.129:0/637874702 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0b59e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c09b2c0 con 0x7f9c0c09d2a0 2020-01-26T15:28:40.104 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0a59c700 -1 --2- 172.21.15.129:0/637874702 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 0x7f9c0c07cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9c0a59c700 1 --2- 172.21.15.129:0/637874702 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 0x7f9c0c07cfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380930907 0 0) 0x7f9c0c09e800 con 0x7f9c0c060220 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf0003230 con 0x7f9c0c060220 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394413479 0 0) 0x7f9c0c07cc90 con 0x7f9c0c07bed0 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c0c09e800 con 0x7f9c0c07bed0 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 871894109 0 0) 0x7f9bf0003230 con 0x7f9c0c060220 2020-01-26T15:28:40.105 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c0c07cc90 con 0x7f9c0c060220 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9bfc002780 con 0x7f9c0c060220 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 118960815 0 0) 0x7f9c0c07cc90 con 0x7f9c0c060220 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 msgr2=0x7f9c0c07cfa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.102+0000 7f9bfb7fe700 1 --2- 172.21.15.129:0/637874702 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 0x7f9c0c07cfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 >> v1:172.21.15.129:6789/0 conn(0x7f9c0c07bed0 legacy=0x7f9c0c136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c07c300 con 0x7f9c0c060220 2020-01-26T15:28:40.106 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c07c5d0 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0247b0 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9bfc000e90 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9bfc001270 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f9bfc001470 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f9bfc04ba70 con 0x7f9c0c060220 2020-01-26T15:28:40.107 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.106+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be4003360 con 0x7f9c0c060220 2020-01-26T15:28:40.110 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.114+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f9bfc030f90 con 0x7f9c0c060220 2020-01-26T15:28:40.267 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.270+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9be40037d0 con 0x7f9c0c060220 2020-01-26T15:28:40.268 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.270+0000 7f9bfb7fe700 1 -- 172.21.15.129:0/637874702 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f9bfc04a6e0 con 0x7f9c0c060220 2020-01-26T15:28:40.268 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:40.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.270+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 >> v1:172.21.15.129:6800/16899 conn(0x7f9bf003e260 legacy=0x7f9bf0040770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:40.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.270+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 >> v1:172.21.15.129:6791/0 conn(0x7f9c0c060220 legacy=0x7f9c0c09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:40.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.274+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 shutdown_connections 2020-01-26T15:28:40.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.274+0000 7f9c0b59e700 1 --2- 172.21.15.129:0/637874702 >> v2:172.21.15.129:6790/0 conn(0x7f9c0c09d2a0 0x7f9c0c07cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:40.277 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.274+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 >> 172.21.15.129:0/637874702 conn(0x7f9c0c07f500 msgr2=0x7f9c0c07dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:40.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.274+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 shutdown_connections 2020-01-26T15:28:40.278 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:40.274+0000 7f9c0b59e700 1 -- 172.21.15.129:0/637874702 wait complete. 2020-01-26T15:28:40.280 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:43.282 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:43.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 Processor -- start 2020-01-26T15:28:43.400 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 -- start start 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 0x7f2dc805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc8098000 con 0x7f2dc80a6870 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc805e050 con 0x7f2dc8149040 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcc84c700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc80a6ca0 con 0x7f2dc805edd0 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc759e700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 0x7f2dc805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:43.401 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 0x7f2dc805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcd04d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f2dc8149040 0x7f2dc814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49838/0 (socket says 172.21.15.129:49838) 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dcd04d700 1 -- 172.21.15.129:0/3346441635 learned_addr learned my addr 172.21.15.129:0/3346441635 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555906725 0 0) 0x7f2dc805e050 con 0x7f2dc8149040 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db0003230 con 0x7f2dc8149040 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397037246 0 0) 0x7f2dc8098000 con 0x7f2dc80a6870 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc805e050 con 0x7f2dc80a6870 2020-01-26T15:28:43.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2414848119 0 0) 0x7f2db0003230 con 0x7f2dc8149040 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 msgr2=0x7f2dc805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.397+0000 7f2dc659c700 1 --2- 172.21.15.129:0/3346441635 >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 0x7f2dc805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 >> v1:172.21.15.129:6789/0 conn(0x7f2dc80a6870 legacy=0x7f2dc807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc814ecb0 con 0x7f2dc8149040 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2db8001640 con 0x7f2dc8149040 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2db8001910 con 0x7f2dc8149040 2020-01-26T15:28:43.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3346441635 >> v1:172.21.15.129:6790/0 conn(0x7f2dc8149040 legacy=0x7f2dc814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc659c700 1 -- 172.21.15.129:0/3346441635 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2db80045b0 con 0x7f2dc8149040 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3346441635 shutdown_connections 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 --2- 172.21.15.129:0/3346441635 >> v2:172.21.15.129:6790/0 conn(0x7f2dc805edd0 0x7f2dc805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3346441635 >> 172.21.15.129:0/3346441635 conn(0x7f2dc8098e70 msgr2=0x7f2dc80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3346441635 shutdown_connections 2020-01-26T15:28:43.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3346441635 wait complete. 2020-01-26T15:28:43.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 Processor -- start 2020-01-26T15:28:43.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- start start 2020-01-26T15:28:43.412 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 0x7f2dc813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc8025270 con 0x7f2dc8024af0 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80a3660 con 0x7f2dc80a3070 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dcc84c700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc807a5e0 con 0x7f2dc807a1b0 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc759e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f2dc8024af0 0x7f2dc80a10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49842/0 (socket says 172.21.15.129:49842) 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.401+0000 7f2dc759e700 1 -- 172.21.15.129:0/3814373781 learned_addr learned my addr 172.21.15.129:0/3814373781 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:43.413 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008153162 0 0) 0x7f2dc8025270 con 0x7f2dc8024af0 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da8003230 con 0x7f2dc8024af0 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2dcd04d700 -1 --2- 172.21.15.129:0/3814373781 >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 0x7f2dc813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2dcd04d700 1 --2- 172.21.15.129:0/3814373781 >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 0x7f2dc813bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561894140 0 0) 0x7f2dc80a3660 con 0x7f2dc80a3070 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc8025270 con 0x7f2dc80a3070 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2060405787 0 0) 0x7f2da8003230 con 0x7f2dc8024af0 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2dc80a3660 con 0x7f2dc8024af0 2020-01-26T15:28:43.414 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2dc0002b00 con 0x7f2dc8024af0 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4074398385 0 0) 0x7f2dc80a3660 con 0x7f2dc8024af0 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 msgr2=0x7f2dc813bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 --2- 172.21.15.129:0/3814373781 >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 0x7f2dc813bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 >> v1:172.21.15.129:6791/0 conn(0x7f2dc80a3070 legacy=0x7f2dc80799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc807a7a0 con 0x7f2dc8024af0 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80a1fc0 con 0x7f2dc8024af0 2020-01-26T15:28:43.415 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc80a1a40 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2dc0001210 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f2dc00015f0 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f2dc00017f0 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f2dc004be00 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.405+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0003360 con 0x7f2dc8024af0 2020-01-26T15:28:43.416 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.409+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f2dc807a7a0 con 0x7f2dc8024af0 2020-01-26T15:28:43.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.565+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2da00037d0 con 0x7f2dc8024af0 2020-01-26T15:28:43.565 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.565+0000 7f2daffff700 1 -- 172.21.15.129:0/3814373781 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f2dc0031320 con 0x7f2dc8024af0 2020-01-26T15:28:43.566 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:43.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 >> v1:172.21.15.129:6800/16899 conn(0x7f2da803e280 legacy=0x7f2da8040790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:43.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 >> v1:172.21.15.129:6790/0 conn(0x7f2dc8024af0 legacy=0x7f2dc80a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:43.567 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 shutdown_connections 2020-01-26T15:28:43.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 --2- 172.21.15.129:0/3814373781 >> v2:172.21.15.129:6791/0 conn(0x7f2dc807a1b0 0x7f2dc813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:43.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 >> 172.21.15.129:0/3814373781 conn(0x7f2dc8098f70 msgr2=0x7f2dc809de10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:43.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 shutdown_connections 2020-01-26T15:28:43.568 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:43.569+0000 7f2dcc84c700 1 -- 172.21.15.129:0/3814373781 wait complete. 2020-01-26T15:28:43.578 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:46.579 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.697+0000 7fb07b59e700 1 Processor -- start 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.697+0000 7fb07b59e700 1 -- start start 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c05ea20 con 0x7fb07c05edd0 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c098000 con 0x7fb07c05e5f0 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c05e050 con 0x7fb07c0a6870 2020-01-26T15:28:46.702 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07ad9d700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb07c05edd0 0x7fb07c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41550/0 (socket says 172.21.15.129:41550) 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07ad9d700 1 -- 172.21.15.129:0/1958884755 learned_addr learned my addr 172.21.15.129:0/1958884755 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963442641 0 0) 0x7fb07c05e050 con 0x7fb07c0a6870 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb064003230 con 0x7fb07c0a6870 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174347080 0 0) 0x7fb07c05ea20 con 0x7fb07c05edd0 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c05e050 con 0x7fb07c05edd0 2020-01-26T15:28:46.703 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452245392 0 0) 0x7fb07c098000 con 0x7fb07c05e5f0 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c05ea20 con 0x7fb07c05e5f0 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2254136736 0 0) 0x7fb07c05ea20 con 0x7fb07c05e5f0 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 >> v1:172.21.15.129:6791/0 conn(0x7fb07c0a6870 legacy=0x7fb07c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 >> v1:172.21.15.129:6789/0 conn(0x7fb07c05edd0 legacy=0x7fb07c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0a6ca0 con 0x7fb07c05e5f0 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb0700015b0 con 0x7fb07c05e5f0 2020-01-26T15:28:46.704 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb070001880 con 0x7fb07c05e5f0 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb079d9b700 1 -- 172.21.15.129:0/1958884755 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb070001ca0 con 0x7fb07c05e5f0 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- 172.21.15.129:0/1958884755 >> v1:172.21.15.129:6790/0 conn(0x7fb07c05e5f0 legacy=0x7fb07c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- 172.21.15.129:0/1958884755 shutdown_connections 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- 172.21.15.129:0/1958884755 >> 172.21.15.129:0/1958884755 conn(0x7fb07c098e70 msgr2=0x7fb07c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- 172.21.15.129:0/1958884755 shutdown_connections 2020-01-26T15:28:46.705 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.701+0000 7fb07b59e700 1 -- 172.21.15.129:0/1958884755 wait complete. 2020-01-26T15:28:46.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 Processor -- start 2020-01-26T15:28:46.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 -- start start 2020-01-26T15:28:46.711 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb07c077fd0 0x7fb07c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0a19a0 con 0x7fb07c1407d0 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c077ba0 con 0x7fb07c143b60 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07b59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0a1530 con 0x7fb07c077fd0 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07ad9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fb07c077fd0 0x7fb07c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07a59c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fb07c143b60 0x7fb07c13ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49858/0 (socket says 172.21.15.129:49858) 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb080a00700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fb07c1407d0 0x7fb07c159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41560/0 (socket says 172.21.15.129:41560) 2020-01-26T15:28:46.712 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07a59c700 1 -- 172.21.15.129:0/2004682615 learned_addr learned my addr 172.21.15.129:0/2004682615 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb07ad9d700 1 --2- 172.21.15.129:0/2004682615 >> v2:172.21.15.129:6791/0 conn(0x7fb07c077fd0 0x7fb07c143610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837512060 0 0) 0x7fb07c077ba0 con 0x7fb07c143b60 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003230 con 0x7fb07c143b60 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017414446 0 0) 0x7fb07c0a19a0 con 0x7fb07c1407d0 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.705+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c077ba0 con 0x7fb07c1407d0 2020-01-26T15:28:46.713 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4230585604 0 0) 0x7fb060003230 con 0x7fb07c143b60 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb07c0a19a0 con 0x7fb07c143b60 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb070001b30 con 0x7fb07c143b60 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2261767243 0 0) 0x7fb07c077ba0 con 0x7fb07c1407d0 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb060003230 con 0x7fb07c1407d0 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fb074001b00 con 0x7fb07c1407d0 2020-01-26T15:28:46.714 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 >> v2:172.21.15.129:6791/0 conn(0x7fb07c077fd0 msgr2=0x7fb07c143610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 --2- 172.21.15.129:0/2004682615 >> v2:172.21.15.129:6791/0 conn(0x7fb07c077fd0 0x7fb07c143610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 >> v1:172.21.15.129:6790/0 conn(0x7fb07c143b60 legacy=0x7fb07c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 >> v1:172.21.15.129:6789/0 conn(0x7fb07c1407d0 legacy=0x7fb07c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb07c0a19a0 con 0x7fb060003ec0 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fb07c077ba0 con 0x7fb060004da0 2020-01-26T15:28:46.715 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a1530 con 0x7fb06000c000 2020-01-26T15:28:46.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:46.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206238574 0 0) 0x7fb07c077ba0 con 0x7fb060004da0 2020-01-26T15:28:46.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb06000e990 con 0x7fb060004da0 2020-01-26T15:28:46.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163874890 0 0) 0x7fb07c0a19a0 con 0x7fb060003ec0 2020-01-26T15:28:46.716 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c077ba0 con 0x7fb060003ec0 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 -- 172.21.15.129:0/2004682615 >> v1:172.21.15.129:6791/0 conn(0x7fb060004da0 legacy=0x7fb06000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 -- 172.21.15.129:0/2004682615 >> v1:172.21.15.129:6790/0 conn(0x7fb060003ec0 legacy=0x7fb0600045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fb07c07f8b0 con 0x7fb06000c000 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0a1100 con 0x7fb06000c000 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.717 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c140c00 con 0x7fb06000c000 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fb07400f070 con 0x7fb06000c000 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074009590 con 0x7fb06000c000 2020-01-26T15:28:46.718 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.709+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054003360 con 0x7fb06000c000 2020-01-26T15:28:46.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.713+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fb074009780 con 0x7fb06000c000 2020-01-26T15:28:46.719 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.713+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.713+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fb07404d640 con 0x7fb06000c000 2020-01-26T15:28:46.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.717+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.720 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.717+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fb0740337f0 con 0x7fb06000c000 2020-01-26T15:28:46.876 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb054003790 con 0x7fb06000c000 2020-01-26T15:28:46.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb080a00700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:46.877 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb06b7fe700 1 -- 172.21.15.129:0/2004682615 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fb074033a50 con 0x7fb06000c000 2020-01-26T15:28:46.877 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:46.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 >> v1:172.21.15.129:6800/16899 conn(0x7fb0600485a0 legacy=0x7fb06004aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 msgr2=0x7fb06000e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:46.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7fb074000f50 tx=0x7fb074011440).stop 2020-01-26T15:28:46.878 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb080a00700 1 -- 172.21.15.129:0/2004682615 reap_dead start 2020-01-26T15:28:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 shutdown_connections 2020-01-26T15:28:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 --2- 172.21.15.129:0/2004682615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fb06000c000 0x7fb06000e440 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 >> 172.21.15.129:0/2004682615 conn(0x7fb07c05bfc0 msgr2=0x7fb07c0a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 shutdown_connections 2020-01-26T15:28:46.879 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:46.876+0000 7fb07b59e700 1 -- 172.21.15.129:0/2004682615 wait complete. 2020-01-26T15:28:46.898 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:49.899 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:50.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 Processor -- start 2020-01-26T15:28:50.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 -- start start 2020-01-26T15:28:50.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 0x7f6b9805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:50.025 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 0x7f6b9807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b98098000 con 0x7f6b980804d0 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9805e050 con 0x7f6b9805edd0 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980a6ca0 con 0x7f6b980a6870 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9d008700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f6b980804d0 0x7f6b980247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47488/0 (socket says 172.21.15.129:47488) 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9d008700 1 -- 172.21.15.129:0/2359924966 learned_addr learned my addr 172.21.15.129:0/2359924966 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:50.026 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b96d9d700 -1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 0x7f6b9807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9759e700 -1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 0x7f6b9805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9759e700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 0x7f6b9805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 0x7f6b9807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550579012 0 0) 0x7f6b98098000 con 0x7f6b980804d0 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b84003230 con 0x7f6b980804d0 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 424087180 0 0) 0x7f6b84003230 con 0x7f6b980804d0 2020-01-26T15:28:50.027 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 msgr2=0x7f6b9807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 0x7f6b9807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 msgr2=0x7f6b9805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 0x7f6b9805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98024fb0 con 0x7f6b980804d0 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6b90001710 con 0x7f6b980804d0 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6b90001aa0 con 0x7f6b980804d0 2020-01-26T15:28:50.028 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9659c700 1 -- 172.21.15.129:0/2359924966 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6b90004760 con 0x7f6b980804d0 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.020+0000 7f6b9c807700 1 -- 172.21.15.129:0/2359924966 >> v1:172.21.15.129:6791/0 conn(0x7f6b980804d0 legacy=0x7f6b980247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 -- 172.21.15.129:0/2359924966 shutdown_connections 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6790/0 conn(0x7f6b9805edd0 0x7f6b9805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 --2- 172.21.15.129:0/2359924966 >> v2:172.21.15.129:6791/0 conn(0x7f6b980a6870 0x7f6b9807ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 -- 172.21.15.129:0/2359924966 >> 172.21.15.129:0/2359924966 conn(0x7f6b98098e70 msgr2=0x7f6b980a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 -- 172.21.15.129:0/2359924966 shutdown_connections 2020-01-26T15:28:50.029 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 -- 172.21.15.129:0/2359924966 wait complete. 2020-01-26T15:28:50.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 Processor -- start 2020-01-26T15:28:50.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.024+0000 7f6b9c807700 1 -- start start 2020-01-26T15:28:50.034 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9c807700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f6b9809f4b0 0x7f6b9809f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9c807700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b98120d60 con 0x7f6b9809a2a0 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9c807700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b980a1190 con 0x7f6b980a0b80 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9c807700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f6b98120280 con 0x7f6b9809f4b0 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9759e700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f6b980a0b80 0x7f6b98099aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49876/0 (socket says 172.21.15.129:49876) 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9759e700 1 -- 172.21.15.129:0/2782243 learned_addr learned my addr 172.21.15.129:0/2782243 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9d008700 -1 --2- 172.21.15.129:0/2782243 >> v2:172.21.15.129:6790/0 conn(0x7f6b9809f4b0 0x7f6b9809f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:50.035 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b9d008700 1 --2- 172.21.15.129:0/2782243 >> v2:172.21.15.129:6790/0 conn(0x7f6b9809f4b0 0x7f6b9809f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978682555 0 0) 0x7f6b98120d60 con 0x7f6b9809a2a0 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b7c003230 con 0x7f6b9809a2a0 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834442122 0 0) 0x7f6b980a1190 con 0x7f6b980a0b80 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98120d60 con 0x7f6b980a0b80 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 350100483 0 0) 0x7f6b7c003230 con 0x7f6b9809a2a0 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b980a1190 con 0x7f6b9809a2a0 2020-01-26T15:28:50.036 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f6b80002680 con 0x7f6b9809a2a0 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 >> v2:172.21.15.129:6790/0 conn(0x7f6b9809f4b0 msgr2=0x7f6b9809f8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 --2- 172.21.15.129:0/2782243 >> v2:172.21.15.129:6790/0 conn(0x7f6b9809f4b0 0x7f6b9809f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 >> v1:172.21.15.129:6790/0 conn(0x7f6b980a0b80 legacy=0x7f6b98099aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 >> v1:172.21.15.129:6789/0 conn(0x7f6b9809a2a0 legacy=0x7f6b9809ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6b7c003230 con 0x7f6b7c00a7f0 2020-01-26T15:28:50.037 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f6b7c00f450 con 0x7f6b7c004c90 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b98120280 con 0x7f6b7c005140 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229856427 0 0) 0x7f6b7c00f450 con 0x7f6b7c004c90 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b7c00e550 con 0x7f6b7c004c90 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287439886 0 0) 0x7f6b7c003230 con 0x7f6b7c00a7f0 2020-01-26T15:28:50.038 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b7c00f450 con 0x7f6b7c00a7f0 2020-01-26T15:28:50.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.028+0000 7f6b96d9d700 1 -- 172.21.15.129:0/2782243 >> v1:172.21.15.129:6791/0 conn(0x7f6b7c004c90 legacy=0x7f6b7c003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 -- 172.21.15.129:0/2782243 >> v1:172.21.15.129:6790/0 conn(0x7f6b7c00a7f0 legacy=0x7f6b7c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9807e800 con 0x7f6b7c005140 2020-01-26T15:28:50.039 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b980a0b80 con 0x7f6b7c005140 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b98099aa0 con 0x7f6b7c005140 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6b80011af0 con 0x7f6b7c005140 2020-01-26T15:28:50.040 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80011cf0 con 0x7f6b7c005140 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f6b80005930 con 0x7f6b7c005140 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b70003360 con 0x7f6b7c005140 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f6b80005c00 con 0x7f6b7c005140 2020-01-26T15:28:50.041 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.032+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f6b8004d740 con 0x7f6b7c005140 2020-01-26T15:28:50.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.040+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.042 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.040+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f6b800338d0 con 0x7f6b7c005140 2020-01-26T15:28:50.202 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.200+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6b70003790 con 0x7f6b7c005140 2020-01-26T15:28:50.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.200+0000 7f6b96d9d700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:50.203 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.200+0000 7f6b8ffff700 1 -- 172.21.15.129:0/2782243 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f6b80033b30 con 0x7f6b7c005140 2020-01-26T15:28:50.203 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 >> v1:172.21.15.129:6800/16899 conn(0x7f6b7c048500 legacy=0x7f6b7c04aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 msgr2=0x7f6b7c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f6b80002490 tx=0x7f6b800114a0).stop 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9d008700 1 -- 172.21.15.129:0/2782243 reap_dead start 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 shutdown_connections 2020-01-26T15:28:50.205 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 --2- 172.21.15.129:0/2782243 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f6b7c005140 0x7f6b7c003de0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:50.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 >> 172.21.15.129:0/2782243 conn(0x7f6b980a7b20 msgr2=0x7f6b9807f230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:50.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 shutdown_connections 2020-01-26T15:28:50.206 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:50.204+0000 7f6b9c807700 1 -- 172.21.15.129:0/2782243 wait complete. 2020-01-26T15:28:50.224 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:53.225 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:53.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 Processor -- start 2020-01-26T15:28:53.350 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 -- start start 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f312c05edd0 0x7f312c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c098000 con 0x7f312c0a6870 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c05e050 con 0x7f312c149040 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312b59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0a6ca0 con 0x7f312c05edd0 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3130b31700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f312c149040 0x7f312c14b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49894/0 (socket says 172.21.15.129:49894) 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3130b31700 1 -- 172.21.15.129:0/2809527758 learned_addr learned my addr 172.21.15.129:0/2809527758 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312ad9d700 -1 --2- 172.21.15.129:0/2809527758 >> v2:172.21.15.129:6791/0 conn(0x7f312c05edd0 0x7f312c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:53.351 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312ad9d700 1 --2- 172.21.15.129:0/2809527758 >> v2:172.21.15.129:6791/0 conn(0x7f312c05edd0 0x7f312c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983964740 0 0) 0x7f312c05e050 con 0x7f312c149040 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3118003230 con 0x7f312c149040 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678427566 0 0) 0x7f312c098000 con 0x7f312c0a6870 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f312c05e050 con 0x7f312c0a6870 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3179116159 0 0) 0x7f312c05e050 con 0x7f312c0a6870 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 >> v2:172.21.15.129:6791/0 conn(0x7f312c05edd0 msgr2=0x7f312c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 --2- 172.21.15.129:0/2809527758 >> v2:172.21.15.129:6791/0 conn(0x7f312c05edd0 0x7f312c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:53.352 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 >> v1:172.21.15.129:6790/0 conn(0x7f312c149040 legacy=0x7f312c14b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c14ecb0 con 0x7f312c0a6870 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3114001a70 con 0x7f312c0a6870 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 >> v1:172.21.15.129:6789/0 conn(0x7f312c0a6870 legacy=0x7f312c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f312c05e050 con 0x7f3118004b20 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f312c098000 con 0x7f311800a7f0 2020-01-26T15:28:53.353 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0a6ca0 con 0x7f3118004f70 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968016651 0 0) 0x7f312c05e050 con 0x7f3118004b20 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311800e710 con 0x7f3118004b20 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165190923 0 0) 0x7f312c098000 con 0x7f311800a7f0 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f312c05e050 con 0x7f311800a7f0 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 -- 172.21.15.129:0/2809527758 >> v1:172.21.15.129:6791/0 conn(0x7f311800a7f0 legacy=0x7f311800cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 -- 172.21.15.129:0/2809527758 >> v1:172.21.15.129:6790/0 conn(0x7f3118004b20 legacy=0x7f3118003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 144801738 0 0) 0x7f311800e710 con 0x7f3118004b20 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 -- 172.21.15.129:0/2809527758 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311800e440 con 0x7f3118004f70 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f311c001250 tx=0x7f311c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f311c001250 tx=0x7f311c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.347+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f311c001250 tx=0x7f311c001640).ready entity=mon.0 client_cookie=95d9eceb553d63d4 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f311c001250 tx=0x7f311c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f311c001250 tx=0x7f311c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f311c001440 con 0x7f3118004f70 2020-01-26T15:28:53.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312a59c700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f311c001250 tx=0x7f311c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31140113f0 con 0x7f3118004f70 2020-01-26T15:28:53.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f3129d9b700 1 -- 172.21.15.129:0/2809527758 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f31140117b0 con 0x7f3118004f70 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 msgr2=0x7f3118003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 --2- 172.21.15.129:0/2809527758 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3118004f70 0x7f3118003d40 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f311c001250 tx=0x7f311c001640).stop 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f3130b31700 1 -- 172.21.15.129:0/2809527758 reap_dead start 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- 172.21.15.129:0/2809527758 shutdown_connections 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- 172.21.15.129:0/2809527758 >> 172.21.15.129:0/2809527758 conn(0x7f312c098e70 msgr2=0x7f312c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:53.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- 172.21.15.129:0/2809527758 shutdown_connections 2020-01-26T15:28:53.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- 172.21.15.129:0/2809527758 wait complete. 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 Processor -- start 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.351+0000 7f312b59e700 1 -- start start 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f312c121e90 0x7f312c07ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c121890 con 0x7f312c12e5e0 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0a0bc0 con 0x7f312c07cf50 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f312c07d380 con 0x7f312c121e90 2020-01-26T15:28:53.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312ad9d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f312c121e90 0x7f312c07ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312ad9d700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f312c121e90 0x7f312c07ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f312c12e5e0 0x7f312c1371f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41606/0 (socket says 172.21.15.129:41606) 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312a59c700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f312c07cf50 0x7f312c12dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49904/0 (socket says 172.21.15.129:49904) 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 -- 172.21.15.129:0/152378898 learned_addr learned my addr 172.21.15.129:0/152378898 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392106146 0 0) 0x7f312c121890 con 0x7f312c12e5e0 2020-01-26T15:28:53.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3110003230 con 0x7f312c12e5e0 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582702059 0 0) 0x7f312c0a0bc0 con 0x7f312c07cf50 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f312c121890 con 0x7f312c07cf50 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1949976936 0 0) 0x7f3110003230 con 0x7f312c12e5e0 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f312c0a0bc0 con 0x7f312c12e5e0 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f3124001aa0 con 0x7f312c12e5e0 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 >> v2:172.21.15.129:6791/0 conn(0x7f312c121e90 msgr2=0x7f312c07ca00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 --2- 172.21.15.129:0/152378898 >> v2:172.21.15.129:6791/0 conn(0x7f312c121e90 0x7f312c07ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:53.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 >> v1:172.21.15.129:6790/0 conn(0x7f312c07cf50 legacy=0x7f312c12dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 >> v1:172.21.15.129:6789/0 conn(0x7f312c12e5e0 legacy=0x7f312c1371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f3110003230 con 0x7f3110003c10 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f311000f570 con 0x7f31100040f0 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c07d380 con 0x7f3110004ed0 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771113280 0 0) 0x7f311000f570 con 0x7f31100040f0 2020-01-26T15:28:53.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311000e560 con 0x7f31100040f0 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328627403 0 0) 0x7f3110003230 con 0x7f3110003c10 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311000f570 con 0x7f3110003c10 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 -- 172.21.15.129:0/152378898 >> v1:172.21.15.129:6791/0 conn(0x7f31100040f0 legacy=0x7f311000a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 -- 172.21.15.129:0/152378898 >> v1:172.21.15.129:6790/0 conn(0x7f3110003c10 legacy=0x7f31100045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0a1ae0 con 0x7f3110004ed0 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c0a0ed0 con 0x7f3110004ed0 2020-01-26T15:28:53.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c025460 con 0x7f3110004ed0 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f312400ec90 con 0x7f3110004ed0 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124010160 con 0x7f3110004ed0 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.355+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f3124010500 con 0x7f3110004ed0 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.359+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.359+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3104003360 con 0x7f3110004ed0 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.359+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f3124007180 con 0x7f3110004ed0 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.359+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.359+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f312404d340 con 0x7f3110004ed0 2020-01-26T15:28:53.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.363+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.372 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.363+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f312c025460 con 0x7f3110004ed0 2020-01-26T15:28:53.533 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3104003790 con 0x7f3110004ed0 2020-01-26T15:28:53.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f3130b31700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:53.534 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f31237fe700 1 -- 172.21.15.129:0/152378898 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f3124033470 con 0x7f3110004ed0 2020-01-26T15:28:53.534 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:53.535 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 >> v1:172.21.15.129:6800/16899 conn(0x7f3110048520 legacy=0x7f311004aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f3130b31700 1 -- 172.21.15.129:0/152378898 reap_dead start 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 msgr2=0x7f311000e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f31240011f0 tx=0x7f3124011110).stop 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 shutdown_connections 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 --2- 172.21.15.129:0/152378898 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f3110004ed0 0x7f311000e010 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 >> 172.21.15.129:0/152378898 conn(0x7f312c0a5520 msgr2=0x7f312c07f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:53.536 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 shutdown_connections 2020-01-26T15:28:53.537 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:53.535+0000 7f312b59e700 1 -- 172.21.15.129:0/152378898 wait complete. 2020-01-26T15:28:53.547 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:56.548 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.663+0000 7fd94dacd700 1 Processor -- start 2020-01-26T15:28:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.663+0000 7fd94dacd700 1 -- start start 2020-01-26T15:28:56.668 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 0x7fd9480a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 0x7fd94814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9480a6dc0 con 0x7fd94805edd0 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd94805ea20 con 0x7fd94805e5f0 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd948098000 con 0x7fd948149040 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94cacb700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 0x7fd9480a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94d2cc700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fd94805edd0 0x7fd94807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47532/0 (socket says 172.21.15.129:47532) 2020-01-26T15:28:56.669 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94d2cc700 1 -- 172.21.15.129:0/2625805518 learned_addr learned my addr 172.21.15.129:0/2625805518 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94cacb700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 0x7fd9480a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94ed2f700 -1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 0x7fd94814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94ed2f700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 0x7fd94814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329323468 0 0) 0x7fd9480a6dc0 con 0x7fd94805edd0 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd934003230 con 0x7fd94805edd0 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2463072000 0 0) 0x7fd934003230 con 0x7fd94805edd0 2020-01-26T15:28:56.670 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 msgr2=0x7fd94814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 0x7fd94814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 msgr2=0x7fd9480a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 0x7fd9480a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94805e050 con 0x7fd94805edd0 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd944001710 con 0x7fd94805edd0 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd944001910 con 0x7fd94805edd0 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd93ffff700 1 -- 172.21.15.129:0/2625805518 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd9440045b0 con 0x7fd94805edd0 2020-01-26T15:28:56.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- 172.21.15.129:0/2625805518 >> v1:172.21.15.129:6791/0 conn(0x7fd94805edd0 legacy=0x7fd94807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- 172.21.15.129:0/2625805518 shutdown_connections 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6791/0 conn(0x7fd948149040 0x7fd94814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 --2- 172.21.15.129:0/2625805518 >> v2:172.21.15.129:6790/0 conn(0x7fd94805e5f0 0x7fd9480a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- 172.21.15.129:0/2625805518 >> 172.21.15.129:0/2625805518 conn(0x7fd948098e70 msgr2=0x7fd9480a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- 172.21.15.129:0/2625805518 shutdown_connections 2020-01-26T15:28:56.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.667+0000 7fd94dacd700 1 -- 172.21.15.129:0/2625805518 wait complete. 2020-01-26T15:28:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 Processor -- start 2020-01-26T15:28:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- start start 2020-01-26T15:28:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd9480a3000 0x7fd94809edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:56.676 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9480a2280 con 0x7fd94809f310 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94809e150 con 0x7fd94811fb10 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd94809ea00 con 0x7fd9480a3000 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94cacb700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fd94809f310 0x7fd94811f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41622/0 (socket says 172.21.15.129:41622) 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94cacb700 1 -- 172.21.15.129:0/792362221 learned_addr learned my addr 172.21.15.129:0/792362221 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd9480a3000 0x7fd94809edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> v2:172.21.15.129:6791/0 conn(0x7fd9480a3000 0x7fd94809edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:56.677 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075423059 0 0) 0x7fd94809e150 con 0x7fd94811fb10 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928003230 con 0x7fd94811fb10 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043131220 0 0) 0x7fd9480a2280 con 0x7fd94809f310 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94809e150 con 0x7fd94809f310 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 611864242 0 0) 0x7fd928003230 con 0x7fd94811fb10 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9480a2280 con 0x7fd94811fb10 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd9400029a0 con 0x7fd94811fb10 2020-01-26T15:28:56.678 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 6839823 0 0) 0x7fd94809e150 con 0x7fd94809f310 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd928003230 con 0x7fd94809f310 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd938002660 con 0x7fd94809f310 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 >> v2:172.21.15.129:6791/0 conn(0x7fd9480a3000 msgr2=0x7fd94809edc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 --2- 172.21.15.129:0/792362221 >> v2:172.21.15.129:6791/0 conn(0x7fd9480a3000 0x7fd94809edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 >> v1:172.21.15.129:6790/0 conn(0x7fd94811fb10 legacy=0x7fd94813a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 >> v1:172.21.15.129:6789/0 conn(0x7fd94809f310 legacy=0x7fd94811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:56.679 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd94809e150 con 0x7fd928003a90 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd92800f820 con 0x7fd928003ec0 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94809ea00 con 0x7fd928004f50 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306329835 0 0) 0x7fd94809e150 con 0x7fd928003a90 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92800fa50 con 0x7fd928003a90 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831236138 0 0) 0x7fd92800f820 con 0x7fd928003ec0 2020-01-26T15:28:56.680 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94809e150 con 0x7fd928003ec0 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 -- 172.21.15.129:0/792362221 >> v1:172.21.15.129:6791/0 conn(0x7fd928003ec0 legacy=0x7fd92800d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 -- 172.21.15.129:0/792362221 >> v1:172.21.15.129:6790/0 conn(0x7fd928003a90 legacy=0x7fd9280097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7fd948120c10 con 0x7fd928004f50 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480a3430 con 0x7fd928004f50 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94811fb10 con 0x7fd928004f50 2020-01-26T15:28:56.681 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.671+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd944007180 con 0x7fd928004f50 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944007380 con 0x7fd928004f50 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd920003360 con 0x7fd928004f50 2020-01-26T15:28:56.682 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fd944007570 con 0x7fd928004f50 2020-01-26T15:28:56.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.675+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fd94404cae0 con 0x7fd928004f50 2020-01-26T15:28:56.683 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.683+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.684 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.683+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fd944032c30 con 0x7fd928004f50 2020-01-26T15:28:56.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.843+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd920003790 con 0x7fd928004f50 2020-01-26T15:28:56.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94d2cc700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:56.844 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd93dffb700 1 -- 172.21.15.129:0/792362221 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fd944032e90 con 0x7fd928004f50 2020-01-26T15:28:56.845 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:28:56.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 >> v1:172.21.15.129:6800/16899 conn(0x7fd928048900 legacy=0x7fd92804ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 msgr2=0x7fd928003540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:56.846 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 --2- 172.21.15.129:0/792362221 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd928004f50 0x7fd928003540 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fd944000f10 tx=0x7fd9440109e0).stop 2020-01-26T15:28:56.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94ed2f700 1 -- 172.21.15.129:0/792362221 reap_dead start 2020-01-26T15:28:56.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 shutdown_connections 2020-01-26T15:28:56.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 >> 172.21.15.129:0/792362221 conn(0x7fd94805ef50 msgr2=0x7fd9481232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:56.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 shutdown_connections 2020-01-26T15:28:56.847 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:56.847+0000 7fd94dacd700 1 -- 172.21.15.129:0/792362221 wait complete. 2020-01-26T15:28:56.858 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:28:59.859 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:28:59.978 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 Processor -- start 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 -- start start 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7ed805edd0 0x7f7ed805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7ed80a6870 0x7f7ed807ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8098000 con 0x7f7ed80804d0 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed805e050 con 0x7f7ed80a6870 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edf2b1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80a6ca0 con 0x7f7ed805edd0 2020-01-26T15:28:59.979 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edeab0700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7ed805edd0 0x7f7ed805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7edeab0700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7ed805edd0 0x7f7ed805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f7ed80804d0 0x7f7ed80247b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41638/0 (socket says 172.21.15.129:41638) 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ede2af700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7ed80a6870 0x7f7ed807ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 -- 172.21.15.129:0/3554164972 learned_addr learned my addr 172.21.15.129:0/3554164972 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ede2af700 1 --2- 172.21.15.129:0/3554164972 >> v2:172.21.15.129:6790/0 conn(0x7f7ed80a6870 0x7f7ed807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654836354 0 0) 0x7f7ed8098000 con 0x7f7ed80804d0 2020-01-26T15:28:59.980 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec4003230 con 0x7f7ed80804d0 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1669174459 0 0) 0x7f7ec4003230 con 0x7f7ed80804d0 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 >> v2:172.21.15.129:6791/0 conn(0x7f7ed805edd0 msgr2=0x7f7ed805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 --2- 172.21.15.129:0/3554164972 >> v2:172.21.15.129:6791/0 conn(0x7f7ed805edd0 0x7f7ed805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 >> v2:172.21.15.129:6790/0 conn(0x7f7ed80a6870 msgr2=0x7f7ed807ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 --2- 172.21.15.129:0/3554164972 >> v2:172.21.15.129:6790/0 conn(0x7f7ed80a6870 0x7f7ed807ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:28:59.981 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8024fb0 con 0x7f7ed80804d0 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7ed4001710 con 0x7f7ed80804d0 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 >> v1:172.21.15.129:6789/0 conn(0x7f7ed80804d0 legacy=0x7f7ed80247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7ec4003230 con 0x7f7ec40077d0 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f7ed8098000 con 0x7f7ec4003860 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed805e050 con 0x7f7ec400b5a0 2020-01-26T15:28:59.982 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485570222 0 0) 0x7f7ed8098000 con 0x7f7ec4003860 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec400f300 con 0x7f7ec4003860 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140863259 0 0) 0x7f7ec4003230 con 0x7f7ec40077d0 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 -- 172.21.15.129:0/3554164972 >> v1:172.21.15.129:6791/0 conn(0x7f7ec4003860 legacy=0x7f7ec4003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 -- 172.21.15.129:0/3554164972 >> v1:172.21.15.129:6790/0 conn(0x7f7ec40077d0 legacy=0x7f7ec4009ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 -- 172.21.15.129:0/3554164972 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4054460 con 0x7f7ec400b5a0 2020-01-26T15:28:59.983 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 -- 172.21.15.129:0/3554164972 reap_dead start 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).ready entity=mon.0 client_cookie=cb873fcd0ac1b984 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.974+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7ed40115a0 con 0x7f7ec400b5a0 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:59.984 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4011840 con 0x7f7ec400b5a0 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7ee0513700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 msgr2=0x7f7ec400dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7eddaae700 1 -- 172.21.15.129:0/3554164972 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f7ed4010160 con 0x7f7ec400b5a0 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7f7ed4000fc0 tx=0x7f7ed400c230).stop 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- 172.21.15.129:0/3554164972 shutdown_connections 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 --2- 172.21.15.129:0/3554164972 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f7ec400b5a0 0x7f7ec400dab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:59.985 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- 172.21.15.129:0/3554164972 >> 172.21.15.129:0/3554164972 conn(0x7f7ed8098e70 msgr2=0x7f7ed80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:28:59.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- 172.21.15.129:0/3554164972 shutdown_connections 2020-01-26T15:28:59.986 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- 172.21.15.129:0/3554164972 wait complete. 2020-01-26T15:28:59.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 Processor -- start 2020-01-26T15:28:59.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.978+0000 7f7edf2b1700 1 -- start start 2020-01-26T15:28:59.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 0x7f7ed807ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:59.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 0x7f7ed8131820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:28:59.989 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8131d70 con 0x7f7ed8120350 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed811e100 con 0x7f7ed8120780 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed807f620 con 0x7f7ed811e6c0 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edeab0700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 0x7f7ed807ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ee0513700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 0x7f7ed8131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ede2af700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f7ed8120350 0x7f7ed8131020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49950/0 (socket says 172.21.15.129:49950) 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ee0513700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 0x7f7ed8131820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:59.990 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ede2af700 1 -- 172.21.15.129:0/1101925391 learned_addr learned my addr 172.21.15.129:0/1101925391 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edeab0700 1 --2- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 0x7f7ed807ed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039523377 0 0) 0x7f7ed8131d70 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec0003230 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 603844859 0 0) 0x7f7ec0003230 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7ed8131d70 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7ec8002780 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 191811676 0 0) 0x7f7ed8131d70 con 0x7f7ed8120350 2020-01-26T15:28:59.991 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 msgr2=0x7f7ed807ed80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 --2- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 0x7f7ed807ed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 msgr2=0x7f7ed8131820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 --2- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 0x7f7ed8131820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed811e340 con 0x7f7ed8120350 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed81228b0 con 0x7f7ed8120350 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed81387c0 con 0x7f7ed8120350 2020-01-26T15:28:59.992 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7ec8001030 con 0x7f7ed8120350 2020-01-26T15:28:59.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f7ec8001450 con 0x7f7ed8120350 2020-01-26T15:28:59.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.982+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4003360 con 0x7f7ed8120350 2020-01-26T15:28:59.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.986+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f7ec8001650 con 0x7f7ed8120350 2020-01-26T15:28:59.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.986+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f7ec804b9b0 con 0x7f7ed8120350 2020-01-26T15:28:59.993 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:28:59.990+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f7ec8030ed0 con 0x7f7ed8120350 2020-01-26T15:29:00.174 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7eb40037d0 con 0x7f7ed8120350 2020-01-26T15:29:00.175 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7ecf7fe700 1 -- 172.21.15.129:0/1101925391 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f7ec804a620 con 0x7f7ed8120350 2020-01-26T15:29:00.175 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:00.176 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 >> v1:172.21.15.129:6800/16899 conn(0x7f7ec003e0f0 legacy=0x7f7ec0040600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 >> v1:172.21.15.129:6790/0 conn(0x7f7ed8120350 legacy=0x7f7ed8131020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 shutdown_connections 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 --2- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6790/0 conn(0x7f7ed8120780 0x7f7ed8131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 --2- 172.21.15.129:0/1101925391 >> v2:172.21.15.129:6791/0 conn(0x7f7ed811e6c0 0x7f7ed807ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 >> 172.21.15.129:0/1101925391 conn(0x7f7ed8097b20 msgr2=0x7f7ed8123400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:00.177 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.174+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 shutdown_connections 2020-01-26T15:29:00.178 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:00.178+0000 7f7edf2b1700 1 -- 172.21.15.129:0/1101925391 wait complete. 2020-01-26T15:29:00.192 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:03.192 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:03.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 Processor -- start 2020-01-26T15:29:03.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- start start 2020-01-26T15:29:03.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 0x7f551005e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:03.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5510098000 con 0x7f5510149040 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551005e050 con 0x7f55100a6870 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f55100a6ca0 con 0x7f551005edd0 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5516df9700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f5510149040 0x7f551014b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49960/0 (socket says 172.21.15.129:49960) 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5516df9700 1 -- 172.21.15.129:0/3259394346 learned_addr learned my addr 172.21.15.129:0/3259394346 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5514b95700 1 --1- 172.21.15.129:0/3259394346 >> v1:172.21.15.129:6791/0 conn(0x7f55100a6870 0x7f551007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47572/0 (socket says 172.21.15.129:47572) 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515396700 -1 --2- 172.21.15.129:0/3259394346 >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 0x7f551005e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:03.311 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515396700 1 --2- 172.21.15.129:0/3259394346 >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 0x7f551005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753243971 0 0) 0x7f5510098000 con 0x7f5510149040 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc003230 con 0x7f5510149040 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606583413 0 0) 0x7f551005e050 con 0x7f55100a6870 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5510098000 con 0x7f55100a6870 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1499773757 0 0) 0x7f5510098000 con 0x7f55100a6870 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 msgr2=0x7f551005e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 --2- 172.21.15.129:0/3259394346 >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 0x7f551005e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:03.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 >> v1:172.21.15.129:6790/0 conn(0x7f5510149040 legacy=0x7f551014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551014ecb0 con 0x7f55100a6870 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f55040016f0 con 0x7f55100a6870 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5504001940 con 0x7f55100a6870 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5503fff700 1 -- 172.21.15.129:0/3259394346 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f55040044f0 con 0x7f55100a6870 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- 172.21.15.129:0/3259394346 >> v1:172.21.15.129:6791/0 conn(0x7f55100a6870 legacy=0x7f551007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.306+0000 7f5515b97700 1 -- 172.21.15.129:0/3259394346 shutdown_connections 2020-01-26T15:29:03.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 --2- 172.21.15.129:0/3259394346 >> v2:172.21.15.129:6791/0 conn(0x7f551005edd0 0x7f551005e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:03.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- 172.21.15.129:0/3259394346 >> 172.21.15.129:0/3259394346 conn(0x7f5510098e70 msgr2=0x7f55100a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:03.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- 172.21.15.129:0/3259394346 shutdown_connections 2020-01-26T15:29:03.314 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- 172.21.15.129:0/3259394346 wait complete. 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 Processor -- start 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- start start 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55100a3f20 con 0x7f551012bed0 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5510122b80 con 0x7f5510122750 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5515b97700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5510120cd0 con 0x7f551007b310 2020-01-26T15:29:03.318 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5516df9700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f551012bed0 0x7f5510138190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41666/0 (socket says 172.21.15.129:41666) 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5516df9700 1 -- 172.21.15.129:0/4072751507 learned_addr learned my addr 172.21.15.129:0/4072751507 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.310+0000 7f5514b95700 1 --1- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6790/0 conn(0x7f5510122750 0x7f551012b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:49964/0 (socket says 172.21.15.129:49964) 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362237953 0 0) 0x7f5510122b80 con 0x7f5510122750 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f0003230 con 0x7f5510122750 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483326083 0 0) 0x7f5510120cd0 con 0x7f551007b310 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5510122b80 con 0x7f551007b310 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789069703 0 0) 0x7f55100a3f20 con 0x7f551012bed0 2020-01-26T15:29:03.319 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5510120cd0 con 0x7f551012bed0 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3887283904 0 0) 0x7f5510122b80 con 0x7f551007b310 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55100a3f20 con 0x7f551007b310 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f550c0016a0 con 0x7f551007b310 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3033528081 0 0) 0x7f54f0003230 con 0x7f5510122750 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5510122b80 con 0x7f5510122750 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3383143926 0 0) 0x7f5510120cd0 con 0x7f551012bed0 2020-01-26T15:29:03.320 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54f0003230 con 0x7f551012bed0 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5504001940 con 0x7f5510122750 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f5508002020 con 0x7f551012bed0 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6791/0 conn(0x7f551007b310 legacy=0x7f55100a3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6790/0 conn(0x7f5510122750 legacy=0x7f551012b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6789/0 conn(0x7f551012bed0 legacy=0x7f5510138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:03.321 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f5510120cd0 con 0x7f54f000aff0 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f54f000fc50 con 0x7f54f0003ec0 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0010e90 con 0x7f54f0003540 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244245682 0 0) 0x7f54f000fc50 con 0x7f54f0003ec0 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f000fe80 con 0x7f54f0003ec0 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6791/0 conn(0x7f54f0003ec0 legacy=0x7f54f00097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.322 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6790/0 conn(0x7f54f000aff0 legacy=0x7f54f000d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692063594 0 0) 0x7f5510120cd0 con 0x7f54f000aff0 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f551007bdf0 con 0x7f54f0003540 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551012c300 con 0x7f54f0003540 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:03.323 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5510122750 con 0x7f54f0003540 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f550c00cc10 con 0x7f54f0003540 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00ce10 con 0x7f54f0003540 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f550c00e160 con 0x7f54f0003540 2020-01-26T15:29:03.324 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.314+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f550c04d430 con 0x7f54f0003540 2020-01-26T15:29:03.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.318+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8003360 con 0x7f54f0003540 2020-01-26T15:29:03.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.322+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.325 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.322+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f550c033580 con 0x7f54f0003540 2020-01-26T15:29:03.479 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f54e8003790 con 0x7f54f0003540 2020-01-26T15:29:03.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5515396700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:03.480 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5501ffb700 1 -- 172.21.15.129:0/4072751507 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f550c0337e0 con 0x7f54f0003540 2020-01-26T15:29:03.480 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:03.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 >> v1:172.21.15.129:6800/16899 conn(0x7f54f0048bb0 legacy=0x7f54f004b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 msgr2=0x7f54f0003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:03.481 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5515b97700 1 --2- 172.21.15.129:0/4072751507 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f54f0003540 0x7f54f0003970 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f550c0014b0 tx=0x7f550c0114a0).stop 2020-01-26T15:29:03.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.478+0000 7f5516df9700 1 -- 172.21.15.129:0/4072751507 reap_dead start 2020-01-26T15:29:03.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.482+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 shutdown_connections 2020-01-26T15:29:03.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.482+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 >> 172.21.15.129:0/4072751507 conn(0x7f55100a7c10 msgr2=0x7f55100a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:03.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.482+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 shutdown_connections 2020-01-26T15:29:03.482 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:03.482+0000 7f5515b97700 1 -- 172.21.15.129:0/4072751507 wait complete. 2020-01-26T15:29:03.492 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:06.494 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:06.619 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 Processor -- start 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 -- start start 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc5c005e5f0 0x7fc5c00a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc5c0149040 0x7fc5c014b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c00a6dc0 con 0x7fc5c005edd0 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c005ea20 con 0x7fc5c0149040 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c0098000 con 0x7fc5c005e5f0 2020-01-26T15:29:06.620 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bf7fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc5c005e5f0 0x7fc5c00a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bf7fe700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc5c005e5f0 0x7fc5c00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c5c0b700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc5c0149040 0x7fc5c014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc5c005edd0 0x7fc5c007ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41676/0 (socket says 172.21.15.129:41676) 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 -- 172.21.15.129:0/957628770 learned_addr learned my addr 172.21.15.129:0/957628770 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c5c0b700 1 --2- 172.21.15.129:0/957628770 >> v2:172.21.15.129:6790/0 conn(0x7fc5c0149040 0x7fc5c014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:06.621 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042557089 0 0) 0x7fc5c00a6dc0 con 0x7fc5c005edd0 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ac003230 con 0x7fc5c005edd0 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3036671571 0 0) 0x7fc5ac003230 con 0x7fc5c005edd0 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 >> v2:172.21.15.129:6791/0 conn(0x7fc5c005e5f0 msgr2=0x7fc5c00a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 --2- 172.21.15.129:0/957628770 >> v2:172.21.15.129:6791/0 conn(0x7fc5c005e5f0 0x7fc5c00a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 >> v2:172.21.15.129:6790/0 conn(0x7fc5c0149040 msgr2=0x7fc5c014b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 --2- 172.21.15.129:0/957628770 >> v2:172.21.15.129:6790/0 conn(0x7fc5c0149040 0x7fc5c014b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c005e050 con 0x7fc5c005edd0 2020-01-26T15:29:06.622 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc5b0001a90 con 0x7fc5c005edd0 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 >> v1:172.21.15.129:6789/0 conn(0x7fc5c005edd0 legacy=0x7fc5c007ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc5ac003230 con 0x7fc5ac00a7f0 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc5c00a6dc0 con 0x7fc5ac0045a0 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c005ea20 con 0x7fc5ac003860 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:06.623 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 -- 172.21.15.129:0/957628770 >> v1:172.21.15.129:6791/0 conn(0x7fc5ac0045a0 legacy=0x7fc5ac0049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 -- 172.21.15.129:0/957628770 >> v1:172.21.15.129:6790/0 conn(0x7fc5ac00a7f0 legacy=0x7fc5ac00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796283671 0 0) 0x7fc5ac003230 con 0x7fc5ac00a7f0 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c5c0b700 1 -- 172.21.15.129:0/957628770 reap_dead start 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 -- 172.21.15.129:0/957628770 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac054470 con 0x7fc5ac003860 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.624 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).ready entity=mon.0 client_cookie=444d5c31548b05d2 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc5b0005d60 con 0x7fc5ac003860 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000df80 con 0x7fc5ac003860 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 -- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 msgr2=0x7fc5ac003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5bffff700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.625 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5beffd700 1 -- 172.21.15.129:0/957628770 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc5b000e320 con 0x7fc5ac003860 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.613+0000 7fc5c49a9700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7fc5b0001c90 tx=0x7fc5b000c620).stop 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 -- 172.21.15.129:0/957628770 shutdown_connections 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 --2- 172.21.15.129:0/957628770 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5ac003860 0x7fc5ac003cd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 -- 172.21.15.129:0/957628770 >> 172.21.15.129:0/957628770 conn(0x7fc5c0098e70 msgr2=0x7fc5c00a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 -- 172.21.15.129:0/957628770 shutdown_connections 2020-01-26T15:29:06.626 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 -- 172.21.15.129:0/957628770 wait complete. 2020-01-26T15:29:06.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 Processor -- start 2020-01-26T15:29:06.630 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.617+0000 7fc5c49a9700 1 -- start start 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fc5c00a1fc0 0x7fc5c00a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fc5c01364a0 0x7fc5c01388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c007a070 con 0x7fc5c0122bc0 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c005f290 con 0x7fc5c01364a0 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c00a23f0 con 0x7fc5c00a1fc0 2020-01-26T15:29:06.631 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fc5c0122bc0 0x7fc5c0079870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41688/0 (socket says 172.21.15.129:41688) 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 -- 172.21.15.129:0/1070811523 learned_addr learned my addr 172.21.15.129:0/1070811523 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bf7fe700 -1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6791/0 conn(0x7fc5c00a1fc0 0x7fc5c00a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c5c0b700 -1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6790/0 conn(0x7fc5c01364a0 0x7fc5c01388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bf7fe700 1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6791/0 conn(0x7fc5c00a1fc0 0x7fc5c00a0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c5c0b700 1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6790/0 conn(0x7fc5c01364a0 0x7fc5c01388e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443322384 0 0) 0x7fc5c007a070 con 0x7fc5c0122bc0 2020-01-26T15:29:06.632 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a4003230 con 0x7fc5c0122bc0 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1705977095 0 0) 0x7fc5a4003230 con 0x7fc5c0122bc0 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc5c007a070 con 0x7fc5c0122bc0 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fc5b00018e0 con 0x7fc5c0122bc0 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6791/0 conn(0x7fc5c00a1fc0 msgr2=0x7fc5c00a0900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6791/0 conn(0x7fc5c00a1fc0 0x7fc5c00a0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6790/0 conn(0x7fc5c01364a0 msgr2=0x7fc5c01388e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:06.633 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 --2- 172.21.15.129:0/1070811523 >> v2:172.21.15.129:6790/0 conn(0x7fc5c01364a0 0x7fc5c01388e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 >> v1:172.21.15.129:6789/0 conn(0x7fc5c0122bc0 legacy=0x7fc5c0079870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc5a4003230 con 0x7fc5a40045a0 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fc5a400f450 con 0x7fc5a400a7f0 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c005f290 con 0x7fc5a4003a20 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404916348 0 0) 0x7fc5a400f450 con 0x7fc5a400a7f0 2020-01-26T15:29:06.634 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a400e440 con 0x7fc5a400a7f0 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584761796 0 0) 0x7fc5a4003230 con 0x7fc5a40045a0 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a400f450 con 0x7fc5a40045a0 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 -- 172.21.15.129:0/1070811523 >> v1:172.21.15.129:6791/0 conn(0x7fc5a400a7f0 legacy=0x7fc5a400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 -- 172.21.15.129:0/1070811523 >> v1:172.21.15.129:6790/0 conn(0x7fc5a40045a0 legacy=0x7fc5a40049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00a0e50 con 0x7fc5a4003a20 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c5c0b700 1 -- 172.21.15.129:0/1070811523 reap_dead start 2020-01-26T15:29:06.635 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c01208f0 con 0x7fc5a4003a20 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c00a4cd0 con 0x7fc5a4003a20 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc5b0010160 con 0x7fc5a4003a20 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.621+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.636 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b0010360 con 0x7fc5a4003a20 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fc5b0010700 con 0x7fc5a4003a20 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc598003360 con 0x7fc5a4003a20 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fc5b0010900 con 0x7fc5a4003a20 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.637 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.625+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fc5b004ea60 con 0x7fc5a4003a20 2020-01-26T15:29:06.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.629+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.638 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.629+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fc5b0010c10 con 0x7fc5a4003a20 2020-01-26T15:29:06.795 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.793+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc598003790 con 0x7fc5a4003a20 2020-01-26T15:29:06.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.793+0000 7fc5bffff700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:06.796 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.793+0000 7fc5bcff9700 1 -- 172.21.15.129:0/1070811523 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fc5b0032850 con 0x7fc5a4003a20 2020-01-26T15:29:06.796 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:06.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 >> v1:172.21.15.129:6800/16899 conn(0x7fc5a4040b70 legacy=0x7fc5a4043080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 msgr2=0x7fc5a4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:06.798 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fc5b0001c30 tx=0x7fc5b000b200).stop 2020-01-26T15:29:06.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 shutdown_connections 2020-01-26T15:29:06.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 --2- 172.21.15.129:0/1070811523 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fc5a4003a20 0x7fc5a4003e50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:06.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 >> 172.21.15.129:0/1070811523 conn(0x7fc5c00a10b0 msgr2=0x7fc5c00247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:06.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 shutdown_connections 2020-01-26T15:29:06.799 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:06.797+0000 7fc5c49a9700 1 -- 172.21.15.129:0/1070811523 wait complete. 2020-01-26T15:29:06.809 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:09.810 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 Processor -- start 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 -- start start 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9af40a6870 0x7f9af414c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af405ea20 con 0x7f9af405e5f0 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4098000 con 0x7f9af405edd0 2020-01-26T15:29:09.934 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.925+0000 7f9afad77700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f9af405e050 con 0x7f9af40a6870 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9d75700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f9af405e5f0 0x7f9af4149040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41706/0 (socket says 172.21.15.129:41706) 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9d75700 1 -- 172.21.15.129:0/2547547387 learned_addr learned my addr 172.21.15.129:0/2547547387 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 -1 --2- 172.21.15.129:0/2547547387 >> v2:172.21.15.129:6791/0 conn(0x7f9af40a6870 0x7f9af414c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> v2:172.21.15.129:6791/0 conn(0x7f9af40a6870 0x7f9af414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730954947 0 0) 0x7f9af405ea20 con 0x7f9af405e5f0 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae0003230 con 0x7f9af405e5f0 2020-01-26T15:29:09.935 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223522409 0 0) 0x7f9af4098000 con 0x7f9af405edd0 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af405ea20 con 0x7f9af405edd0 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2307467369 0 0) 0x7f9ae0003230 con 0x7f9af405e5f0 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 >> v2:172.21.15.129:6791/0 conn(0x7f9af40a6870 msgr2=0x7f9af414c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 --2- 172.21.15.129:0/2547547387 >> v2:172.21.15.129:6791/0 conn(0x7f9af40a6870 0x7f9af414c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 >> v1:172.21.15.129:6791/0 conn(0x7f9af405edd0 legacy=0x7f9af407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40a6ca0 con 0x7f9af405e5f0 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9ae4001710 con 0x7f9af405e5f0 2020-01-26T15:29:09.936 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 >> v1:172.21.15.129:6789/0 conn(0x7f9af405e5f0 legacy=0x7f9af4149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9ae0003230 con 0x7f9ae0003ac0 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f9af4098000 con 0x7f9ae0003f90 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af405e050 con 0x7f9ae000b800 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:09.937 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259275666 0 0) 0x7f9af4098000 con 0x7f9ae0003f90 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae000e2a0 con 0x7f9ae0003f90 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273173149 0 0) 0x7f9ae0003230 con 0x7f9ae0003ac0 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af4098000 con 0x7f9ae0003ac0 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 -- 172.21.15.129:0/2547547387 >> v1:172.21.15.129:6791/0 conn(0x7f9ae0003f90 legacy=0x7f9ae0004da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 -- 172.21.15.129:0/2547547387 >> v1:172.21.15.129:6790/0 conn(0x7f9ae0003ac0 legacy=0x7f9ae00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.938 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 -- 172.21.15.129:0/2547547387 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0054510 con 0x7f9ae000b800 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).ready entity=mon.0 client_cookie=b515fe29196d39ca server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9aec005ac0 con 0x7f9ae000b800 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:09.939 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec005cc0 con 0x7f9ae000b800 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 -- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 msgr2=0x7f9ae000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 --2- 172.21.15.129:0/2547547387 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f9ae000b800 0x7f9ae000dc40 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f9aec002f30 tx=0x7f9aec00fe40).stop 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9af9574700 1 -- 172.21.15.129:0/2547547387 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9aec010900 con 0x7f9ae000b800 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afbfd9700 1 -- 172.21.15.129:0/2547547387 reap_dead start 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 -- 172.21.15.129:0/2547547387 shutdown_connections 2020-01-26T15:29:09.940 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 -- 172.21.15.129:0/2547547387 >> 172.21.15.129:0/2547547387 conn(0x7f9af4098e70 msgr2=0x7f9af40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:09.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 -- 172.21.15.129:0/2547547387 shutdown_connections 2020-01-26T15:29:09.941 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.929+0000 7f9afad77700 1 -- 172.21.15.129:0/2547547387 wait complete. 2020-01-26T15:29:09.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 Processor -- start 2020-01-26T15:29:09.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- start start 2020-01-26T15:29:09.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 0x7f9af4062510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:09.943 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4061b10 con 0x7f9af40602b0 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af407e180 con 0x7f9af407c9e0 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f9af4062a60 con 0x7f9af407dd50 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9af9d75700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 0x7f9af4062510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afa576700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f9af40602b0 0x7f9af4061310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50014/0 (socket says 172.21.15.129:50014) 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9af9d75700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 0x7f9af4062510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afa576700 1 -- 172.21.15.129:0/1920782467 learned_addr learned my addr 172.21.15.129:0/1920782467 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:09.944 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553940292 0 0) 0x7f9af4061b10 con 0x7f9af40602b0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc003230 con 0x7f9af40602b0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1218504875 0 0) 0x7f9adc003230 con 0x7f9af40602b0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9af4061b10 con 0x7f9af40602b0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9af0001e00 con 0x7f9af40602b0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996551294 0 0) 0x7f9af407e180 con 0x7f9af407c9e0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc003230 con 0x7f9af407c9e0 2020-01-26T15:29:09.945 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1328367122 0 0) 0x7f9af4061b10 con 0x7f9af40602b0 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 msgr2=0x7f9af4062510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 --2- 172.21.15.129:0/1920782467 >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 0x7f9af4062510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 >> v1:172.21.15.129:6791/0 conn(0x7f9af407c9e0 legacy=0x7f9af407ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af409e090 con 0x7f9af40602b0 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af407d610 con 0x7f9af40602b0 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af4139cd0 con 0x7f9af40602b0 2020-01-26T15:29:09.946 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9af0002570 con 0x7f9af40602b0 2020-01-26T15:29:09.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9af0002990 con 0x7f9af40602b0 2020-01-26T15:29:09.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.933+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f9af0002b90 con 0x7f9af40602b0 2020-01-26T15:29:09.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.937+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af4056600 con 0x7f9af40602b0 2020-01-26T15:29:09.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.937+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (unknown 1168620720 0 0) 0x7f9af004beb0 con 0x7f9af40602b0 2020-01-26T15:29:09.947 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:09.941+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f9af0031370 con 0x7f9af40602b0 2020-01-26T15:29:10.098 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9af405cc60 con 0x7f9af40602b0 2020-01-26T15:29:10.099 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9aeaffd700 1 -- 172.21.15.129:0/1920782467 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f9af0002f20 con 0x7f9af40602b0 2020-01-26T15:29:10.099 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 >> v1:172.21.15.129:6800/16899 conn(0x7f9adc03e230 legacy=0x7f9adc040740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 >> v1:172.21.15.129:6790/0 conn(0x7f9af40602b0 legacy=0x7f9af4061310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 shutdown_connections 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 --2- 172.21.15.129:0/1920782467 >> v2:172.21.15.129:6791/0 conn(0x7f9af407dd50 0x7f9af4062510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 >> 172.21.15.129:0/1920782467 conn(0x7f9af4097ab0 msgr2=0x7f9af40a2680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:10.101 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 shutdown_connections 2020-01-26T15:29:10.102 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:10.097+0000 7f9afad77700 1 -- 172.21.15.129:0/1920782467 wait complete. 2020-01-26T15:29:10.112 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:13.113 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:13.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 Processor -- start 2020-01-26T15:29:13.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 -- start start 2020-01-26T15:29:13.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f892405edd0 0x7f892405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:13.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924098000 con 0x7f89240a6870 2020-01-26T15:29:13.236 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892405e050 con 0x7f8924149040 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8928aa1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f89240a6ca0 con 0x7f892405edd0 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f89237fe700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f89240a6870 0x7f892407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41724/0 (socket says 172.21.15.129:41724) 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f89237fe700 1 -- 172.21.15.129:0/3828020186 learned_addr learned my addr 172.21.15.129:0/3828020186 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8923fff700 -1 --2- 172.21.15.129:0/3828020186 >> v2:172.21.15.129:6791/0 conn(0x7f892405edd0 0x7f892405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.224+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> v2:172.21.15.129:6791/0 conn(0x7f892405edd0 0x7f892405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106118921 0 0) 0x7f8924098000 con 0x7f89240a6870 2020-01-26T15:29:13.237 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c003230 con 0x7f89240a6870 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974811926 0 0) 0x7f892405e050 con 0x7f8924149040 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8924098000 con 0x7f8924149040 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1841270325 0 0) 0x7f890c003230 con 0x7f89240a6870 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 >> v2:172.21.15.129:6791/0 conn(0x7f892405edd0 msgr2=0x7f892405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 --2- 172.21.15.129:0/3828020186 >> v2:172.21.15.129:6791/0 conn(0x7f892405edd0 0x7f892405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:13.238 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 >> v1:172.21.15.129:6791/0 conn(0x7f8924149040 legacy=0x7f892414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892414ecb0 con 0x7f89240a6870 2020-01-26T15:29:13.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8918001710 con 0x7f89240a6870 2020-01-26T15:29:13.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 >> v1:172.21.15.129:6789/0 conn(0x7f89240a6870 legacy=0x7f892407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:13.239 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f890c003230 con 0x7f890c00a7f0 2020-01-26T15:29:13.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8924098000 con 0x7f890c003540 2020-01-26T15:29:13.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240a6ca0 con 0x7f890c004b20 2020-01-26T15:29:13.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:13.241 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 -- 172.21.15.129:0/3828020186 >> v1:172.21.15.129:6791/0 conn(0x7f890c003540 legacy=0x7f890c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 -- 172.21.15.129:0/3828020186 >> v1:172.21.15.129:6790/0 conn(0x7f890c00a7f0 legacy=0x7f890c00cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953496979 0 0) 0x7f8924098000 con 0x7f890c003540 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 -- 172.21.15.129:0/3828020186 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c054530 con 0x7f890c004b20 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8914008900 tx=0x7f891400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8914008900 tx=0x7f891400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8914008900 tx=0x7f891400fe60).ready entity=mon.0 client_cookie=310ae13a3e66c004 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8914008900 tx=0x7f891400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.242 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8914008ca0 con 0x7f890c004b20 2020-01-26T15:29:13.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8914008900 tx=0x7f891400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914005780 con 0x7f890c004b20 2020-01-26T15:29:13.243 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8923fff700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f8914008900 tx=0x7f891400fe60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8922ffd700 1 -- 172.21.15.129:0/3828020186 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8914005b20 con 0x7f890c004b20 2020-01-26T15:29:13.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 -- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 msgr2=0x7f890c004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.245 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 --2- 172.21.15.129:0/3828020186 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f890c004b20 0x7f890c004f50 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f8914008900 tx=0x7f891400fe60).stop 2020-01-26T15:29:13.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8929d03700 1 -- 172.21.15.129:0/3828020186 reap_dead start 2020-01-26T15:29:13.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 -- 172.21.15.129:0/3828020186 shutdown_connections 2020-01-26T15:29:13.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 -- 172.21.15.129:0/3828020186 >> 172.21.15.129:0/3828020186 conn(0x7f8924098e70 msgr2=0x7f89240a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:13.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 -- 172.21.15.129:0/3828020186 shutdown_connections 2020-01-26T15:29:13.246 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.228+0000 7f8928aa1700 1 -- 172.21.15.129:0/3828020186 wait complete. 2020-01-26T15:29:13.250 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.232+0000 7f8928aa1700 1 Processor -- start 2020-01-26T15:29:13.250 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.232+0000 7f8928aa1700 1 -- start start 2020-01-26T15:29:13.250 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f89241236e0 0x7f8924123b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240a13a0 con 0x7f8924136600 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924025580 con 0x7f8924121180 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f89240a0f30 con 0x7f89241236e0 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f89241236e0 0x7f8924123b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f89241236e0 0x7f8924123b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8929d03700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f8924136600 0x7f8924138a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41738/0 (socket says 172.21.15.129:41738) 2020-01-26T15:29:13.251 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f89237fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f8924121180 0x7f89241215b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50036/0 (socket says 172.21.15.129:50036) 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8929d03700 1 -- 172.21.15.129:0/3698790989 learned_addr learned my addr 172.21.15.129:0/3698790989 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095839326 0 0) 0x7f8924025580 con 0x7f8924121180 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8904003230 con 0x7f8924121180 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530955721 0 0) 0x7f89240a13a0 con 0x7f8924136600 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8924025580 con 0x7f8924136600 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2414672513 0 0) 0x7f8924025580 con 0x7f8924136600 2020-01-26T15:29:13.252 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f89240a13a0 con 0x7f8924136600 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f891c001840 con 0x7f8924136600 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 >> v2:172.21.15.129:6791/0 conn(0x7f89241236e0 msgr2=0x7f8924123b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 --2- 172.21.15.129:0/3698790989 >> v2:172.21.15.129:6791/0 conn(0x7f89241236e0 0x7f8924123b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 >> v1:172.21.15.129:6790/0 conn(0x7f8924121180 legacy=0x7f89241215b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 >> v1:172.21.15.129:6789/0 conn(0x7f8924136600 legacy=0x7f8924138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:13.253 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8904003230 con 0x7f890400a7f0 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8924025580 con 0x7f8904003540 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240a0f30 con 0x7f8904004c20 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275317139 0 0) 0x7f8904003230 con 0x7f890400a7f0 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890400e440 con 0x7f890400a7f0 2020-01-26T15:29:13.254 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 -- 172.21.15.129:0/3698790989 >> v1:172.21.15.129:6791/0 conn(0x7f8904003540 legacy=0x7f8904003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109403752 0 0) 0x7f8924025580 con 0x7f8904003540 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 -- 172.21.15.129:0/3698790989 >> v1:172.21.15.129:6790/0 conn(0x7f890400a7f0 legacy=0x7f890400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924124060 con 0x7f8904004c20 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924099a30 con 0x7f8904004c20 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89240a1a10 con 0x7f8904004c20 2020-01-26T15:29:13.255 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8914010c80 con 0x7f8904004c20 2020-01-26T15:29:13.256 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914007160 con 0x7f8904004c20 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8914007540 con 0x7f8904004c20 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f891400a180 con 0x7f8904004c20 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.236+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.240+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc003360 con 0x7f8904004c20 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.240+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f891404d3b0 con 0x7f8904004c20 2020-01-26T15:29:13.257 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.244+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.258 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.244+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f89140337c0 con 0x7f8904004c20 2020-01-26T15:29:13.402 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f88fc003790 con 0x7f8904004c20 2020-01-26T15:29:13.403 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8923fff700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:13.404 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8920ff9700 1 -- 172.21.15.129:0/3698790989 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8914007740 con 0x7f8904004c20 2020-01-26T15:29:13.404 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:13.405 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 >> v1:172.21.15.129:6800/16899 conn(0x7f8904048100 legacy=0x7f890404a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 msgr2=0x7f8904005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:13.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8929d03700 1 -- 172.21.15.129:0/3698790989 reap_dead start 2020-01-26T15:29:13.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f8914008900 tx=0x7f89140107f0).stop 2020-01-26T15:29:13.406 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 shutdown_connections 2020-01-26T15:29:13.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 --2- 172.21.15.129:0/3698790989 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f8904004c20 0x7f8904005050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:13.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 >> 172.21.15.129:0/3698790989 conn(0x7f89240a6870 msgr2=0x7f892407f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:13.407 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 shutdown_connections 2020-01-26T15:29:13.408 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:13.400+0000 7f8928aa1700 1 -- 172.21.15.129:0/3698790989 wait complete. 2020-01-26T15:29:13.416 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:16.418 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:16.538 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 Processor -- start 2020-01-26T15:29:16.538 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 -- start start 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 0x7ff01805e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff018098000 con 0x7ff0180a6870 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01805e050 con 0x7ff018149040 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01d1eb700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7ff0180a6ca0 con 0x7ff01805edd0 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01c9ea700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 0x7ff01805e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:16.539 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01c9ea700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 0x7ff01805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:16.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01e44d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7ff018149040 0x7ff01814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47668/0 (socket says 172.21.15.129:47668) 2020-01-26T15:29:16.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff01e44d700 1 -- 172.21.15.129:0/1592388068 learned_addr learned my addr 172.21.15.129:0/1592388068 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:16.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff017fff700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ff0180a6870 0x7ff01807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50048/0 (socket says 172.21.15.129:50048) 2020-01-26T15:29:16.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078289780 0 0) 0x7ff01805e050 con 0x7ff018149040 2020-01-26T15:29:16.540 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff8003230 con 0x7ff018149040 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829545212 0 0) 0x7ff018098000 con 0x7ff0180a6870 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01805e050 con 0x7ff0180a6870 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 517351835 0 0) 0x7ff01805e050 con 0x7ff0180a6870 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 msgr2=0x7ff01805e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 --2- 172.21.15.129:0/1592388068 >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 0x7ff01805e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:16.541 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 >> v1:172.21.15.129:6791/0 conn(0x7ff018149040 legacy=0x7ff01814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01814ecb0 con 0x7ff0180a6870 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.528+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff0080019f0 con 0x7ff0180a6870 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.1 v1:172.21.15.129:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff008001c40 con 0x7ff0180a6870 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff0177fe700 1 -- 172.21.15.129:0/1592388068 <== mon.1 v1:172.21.15.129:6790/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff008004870 con 0x7ff0180a6870 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1592388068 >> v1:172.21.15.129:6790/0 conn(0x7ff0180a6870 legacy=0x7ff01807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.542 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1592388068 shutdown_connections 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 --2- 172.21.15.129:0/1592388068 >> v2:172.21.15.129:6791/0 conn(0x7ff01805edd0 0x7ff01805e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1592388068 >> 172.21.15.129:0/1592388068 conn(0x7ff018098e70 msgr2=0x7ff0180a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1592388068 shutdown_connections 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1592388068 wait complete. 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 Processor -- start 2020-01-26T15:29:16.543 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.532+0000 7ff01d1eb700 1 -- start start 2020-01-26T15:29:16.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01d1eb700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff018121c50 con 0x7ff01807d2d0 2020-01-26T15:29:16.547 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01d1eb700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01807d700 con 0x7ff018120770 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01d1eb700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0180a3be0 con 0x7ff01807cea0 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01c9ea700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7ff018120770 0x7ff018121450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50054/0 (socket says 172.21.15.129:50054) 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01c9ea700 1 -- 172.21.15.129:0/1818030990 learned_addr learned my addr 172.21.15.129:0/1818030990 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420580990 0 0) 0x7ff01807d700 con 0x7ff018120770 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff0003230 con 0x7ff018120770 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112888528 0 0) 0x7ff018121c50 con 0x7ff01807d2d0 2020-01-26T15:29:16.548 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01807d700 con 0x7ff01807d2d0 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473790629 0 0) 0x7ff0180a3be0 con 0x7ff01807cea0 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff018121c50 con 0x7ff01807cea0 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1932044653 0 0) 0x7feff0003230 con 0x7ff018120770 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0180a3be0 con 0x7ff018120770 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff0000026b0 con 0x7ff018120770 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1369064834 0 0) 0x7ff01807d700 con 0x7ff01807d2d0 2020-01-26T15:29:16.549 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feff0003230 con 0x7ff01807d2d0 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7ff010001ca0 con 0x7ff01807d2d0 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6791/0 conn(0x7ff01807cea0 legacy=0x7ff0181382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6790/0 conn(0x7ff018120770 legacy=0x7ff018121450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6789/0 conn(0x7ff01807d2d0 legacy=0x7ff01813bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:16.550 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7ff01807d700 con 0x7feff00040f0 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7feff000f9a0 con 0x7feff000ad40 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff0010be0 con 0x7feff0004da0 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918186659 0 0) 0x7ff01807d700 con 0x7feff00040f0 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff000ea50 con 0x7feff00040f0 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6791/0 conn(0x7feff000ad40 legacy=0x7feff000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052270677 0 0) 0x7feff000f9a0 con 0x7feff000ad40 2020-01-26T15:29:16.551 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6790/0 conn(0x7feff00040f0 legacy=0x7feff00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7ff0180980c0 con 0x7feff0004da0 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01807cea0 con 0x7feff0004da0 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff018120770 con 0x7feff0004da0 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.552 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:16.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7ff008004b40 con 0x7feff0004da0 2020-01-26T15:29:16.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.553 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.536+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008004d40 con 0x7feff0004da0 2020-01-26T15:29:16.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.540+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.540+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff4003360 con 0x7feff0004da0 2020-01-26T15:29:16.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.540+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.540+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7ff008006180 con 0x7feff0004da0 2020-01-26T15:29:16.554 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.540+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7ff00804cc90 con 0x7feff0004da0 2020-01-26T15:29:16.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.544+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.555 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.544+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7ff008032de0 con 0x7feff0004da0 2020-01-26T15:29:16.706 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.700+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feff4003790 con 0x7feff0004da0 2020-01-26T15:29:16.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff017fff700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:16.707 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff0157fa700 1 -- 172.21.15.129:0/1818030990 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7ff008033040 con 0x7feff0004da0 2020-01-26T15:29:16.707 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:16.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 >> v1:172.21.15.129:6800/16899 conn(0x7feff0048ac0 legacy=0x7feff004afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.708 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 msgr2=0x7feff000a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:16.709 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 --2- 172.21.15.129:0/1818030990 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7feff0004da0 0x7feff000a7f0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7ff008001460 tx=0x7ff00800cb40).stop 2020-01-26T15:29:16.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01e44d700 1 -- 172.21.15.129:0/1818030990 reap_dead start 2020-01-26T15:29:16.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 shutdown_connections 2020-01-26T15:29:16.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 >> 172.21.15.129:0/1818030990 conn(0x7ff0180a4480 msgr2=0x7ff0180247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:16.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 shutdown_connections 2020-01-26T15:29:16.710 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:16.704+0000 7ff01d1eb700 1 -- 172.21.15.129:0/1818030990 wait complete. 2020-01-26T15:29:16.720 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:19.726 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 Processor -- start 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 -- start start 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1610146c30 0x7f1610149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16100a5b80 con 0x7f16101495c0 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1610080440 con 0x7f16100a5750 2020-01-26T15:29:19.848 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f1615818700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f16100a43f0 con 0x7f1610146c30 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160effd700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1610146c30 0x7f1610149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160effd700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f1610146c30 0x7f1610149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160f7fe700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f16100a5750 0x7f16100a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50068/0 (socket says 172.21.15.129:50068) 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160f7fe700 1 -- 172.21.15.129:0/1368789327 learned_addr learned my addr 172.21.15.129:0/1368789327 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160ffff700 1 --1- 172.21.15.129:0/1368789327 >> v1:172.21.15.129:6789/0 conn(0x7f16101495c0 0x7f161014ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41772/0 (socket says 172.21.15.129:41772) 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408333079 0 0) 0x7f16100a5b80 con 0x7f16101495c0 2020-01-26T15:29:19.849 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f0003230 con 0x7f16101495c0 2020-01-26T15:29:19.854 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310937795 0 0) 0x7f1610080440 con 0x7f16100a5750 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16100a5b80 con 0x7f16100a5750 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3082434689 0 0) 0x7f15f0003230 con 0x7f16101495c0 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.836+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 >> v2:172.21.15.129:6790/0 conn(0x7f1610146c30 msgr2=0x7f1610149070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 --2- 172.21.15.129:0/1368789327 >> v2:172.21.15.129:6790/0 conn(0x7f1610146c30 0x7f1610149070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 >> v1:172.21.15.129:6790/0 conn(0x7f16100a5750 legacy=0x7f16100a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100a4e00 con 0x7f16101495c0 2020-01-26T15:29:19.855 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1608001710 con 0x7f16101495c0 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 >> v1:172.21.15.129:6789/0 conn(0x7f16101495c0 legacy=0x7f161014ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f15f0003230 con 0x7f15f0004af0 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f1610080440 con 0x7f15f000a7f0 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100a43f0 con 0x7f15f0004f40 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061743232 0 0) 0x7f1610080440 con 0x7f15f000a7f0 2020-01-26T15:29:19.856 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f000e440 con 0x7f15f000a7f0 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 -- 172.21.15.129:0/1368789327 >> v1:172.21.15.129:6791/0 conn(0x7f15f000a7f0 legacy=0x7f15f000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 -- 172.21.15.129:0/1368789327 >> v1:172.21.15.129:6790/0 conn(0x7f15f0004af0 legacy=0x7f15f0003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 -- 172.21.15.129:0/1368789327 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0054530 con 0x7f15f0004f40 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f16000032b0 tx=0x7f16000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f16000032b0 tx=0x7f16000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f16000032b0 tx=0x7f16000101e0).ready entity=mon.0 client_cookie=d5222631156d8846 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:19.857 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f16000032b0 tx=0x7f16000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1600010ab0 con 0x7f15f0004f40 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f16000032b0 tx=0x7f16000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160effd700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7f16000032b0 tx=0x7f16000101e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600010cb0 con 0x7f15f0004f40 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160e7fc700 1 -- 172.21.15.129:0/1368789327 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1600011270 con 0x7f15f0004f40 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 -- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 msgr2=0x7f15f0003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.858 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 --2- 172.21.15.129:0/1368789327 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15f0004f40 0x7f15f0003d40 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7f16000032b0 tx=0x7f16000101e0).stop 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f160ffff700 1 -- 172.21.15.129:0/1368789327 reap_dead start 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 -- 172.21.15.129:0/1368789327 shutdown_connections 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 -- 172.21.15.129:0/1368789327 >> 172.21.15.129:0/1368789327 conn(0x7f161005e050 msgr2=0x7f1610098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 -- 172.21.15.129:0/1368789327 shutdown_connections 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 -- 172.21.15.129:0/1368789327 wait complete. 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.840+0000 7f1615818700 1 Processor -- start 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- start start 2020-01-26T15:29:19.859 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f1610094600 0x7f1610131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1610130f80 con 0x7f1610131b80 2020-01-26T15:29:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1610064d70 con 0x7f16100939b0 2020-01-26T15:29:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f16100917a0 con 0x7f1610094600 2020-01-26T15:29:19.860 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160effd700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f1610131b80 0x7f16100931b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41780/0 (socket says 172.21.15.129:41780) 2020-01-26T15:29:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160effd700 1 -- 172.21.15.129:0/1860758469 learned_addr learned my addr 172.21.15.129:0/1860758469 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160f7fe700 -1 --2- 172.21.15.129:0/1860758469 >> v2:172.21.15.129:6791/0 conn(0x7f1610094600 0x7f1610131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160f7fe700 1 --2- 172.21.15.129:0/1860758469 >> v2:172.21.15.129:6791/0 conn(0x7f1610094600 0x7f1610131630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282747049 0 0) 0x7f1610130f80 con 0x7f1610131b80 2020-01-26T15:29:19.861 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e8003230 con 0x7f1610131b80 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580701981 0 0) 0x7f1610064d70 con 0x7f16100939b0 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1610130f80 con 0x7f16100939b0 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1705185039 0 0) 0x7f15e8003230 con 0x7f1610131b80 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1610064d70 con 0x7f1610131b80 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f1600008a00 con 0x7f1610131b80 2020-01-26T15:29:19.865 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 >> v2:172.21.15.129:6791/0 conn(0x7f1610094600 msgr2=0x7f1610131630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 --2- 172.21.15.129:0/1860758469 >> v2:172.21.15.129:6791/0 conn(0x7f1610094600 0x7f1610131630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 >> v1:172.21.15.129:6791/0 conn(0x7f16100939b0 legacy=0x7f1610138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 >> v1:172.21.15.129:6789/0 conn(0x7f1610131b80 legacy=0x7f16100931b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f15e8003230 con 0x7f15e80040e0 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f15e800f570 con 0x7f15e8003c30 2020-01-26T15:29:19.866 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100917a0 con 0x7f15e8004ed0 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26329124 0 0) 0x7f15e8003230 con 0x7f15e80040e0 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e800f7a0 con 0x7f15e80040e0 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371823422 0 0) 0x7f15e800f570 con 0x7f15e8003c30 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e8003230 con 0x7f15e8003c30 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 570931510 0 0) 0x7f15e800f7a0 con 0x7f15e80040e0 2020-01-26T15:29:19.867 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15e800f570 con 0x7f15e80040e0 2020-01-26T15:29:19.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1330686459 0 0) 0x7f15e8003230 con 0x7f15e8003c30 2020-01-26T15:29:19.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15e800f7a0 con 0x7f15e8003c30 2020-01-26T15:29:19.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f16000110c0 con 0x7f15e80040e0 2020-01-26T15:29:19.868 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f15f8001860 con 0x7f15e8003c30 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1380452486 0 0) 0x7f15e800f570 con 0x7f15e80040e0 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 -- 172.21.15.129:0/1860758469 >> v1:172.21.15.129:6791/0 conn(0x7f15e8003c30 legacy=0x7f15e80045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 -- 172.21.15.129:0/1860758469 >> v1:172.21.15.129:6790/0 conn(0x7f15e80040e0 legacy=0x7f15e800a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610094a30 con 0x7f15e8004ed0 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.869 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100939b0 con 0x7f15e8004ed0 2020-01-26T15:29:19.870 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1610136360 con 0x7f15e8004ed0 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.844+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1608010e50 con 0x7f15e8004ed0 2020-01-26T15:29:19.871 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608011050 con 0x7f15e8004ed0 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f1608011470 con 0x7f15e8004ed0 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f1608011670 con 0x7f15e8004ed0 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec003360 con 0x7f15e8004ed0 2020-01-26T15:29:19.872 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.848+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f160804c760 con 0x7f15e8004ed0 2020-01-26T15:29:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.856+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:19.873 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:19.856+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f1608032910 con 0x7f15e8004ed0 2020-01-26T15:29:20.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.008+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f15ec003790 con 0x7f15e8004ed0 2020-01-26T15:29:20.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.008+0000 7f160ffff700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:20.014 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.008+0000 7f1607fff700 1 -- 172.21.15.129:0/1860758469 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f1608032b70 con 0x7f15e8004ed0 2020-01-26T15:29:20.014 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:20.015 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 >> v1:172.21.15.129:6800/16899 conn(0x7f15e8048970 legacy=0x7f15e804ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 msgr2=0x7f15e800e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f160ffff700 1 -- 172.21.15.129:0/1860758469 reap_dead start 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f15f8001aa0 tx=0x7f16000106b0).stop 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 shutdown_connections 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 --2- 172.21.15.129:0/1860758469 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f15e8004ed0 0x7f15e800e010 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 >> 172.21.15.129:0/1860758469 conn(0x7f16100a5750 msgr2=0x7f16100a3210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 shutdown_connections 2020-01-26T15:29:20.016 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:20.012+0000 7f1615818700 1 -- 172.21.15.129:0/1860758469 wait complete. 2020-01-26T15:29:20.026 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:23.028 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 Processor -- start 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 -- start start 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f984c05edd0 0x7f984c05e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f984c149040 0x7f984c14b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c098000 con 0x7f984c0a6870 2020-01-26T15:29:23.152 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f984c05e050 con 0x7f984c149040 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f984c0a6ca0 con 0x7f984c05edd0 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f984c0a6870 0x7f984c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41796/0 (socket says 172.21.15.129:41796) 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f985149d700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f984c05edd0 0x7f984c05e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 -- 172.21.15.129:0/3276710166 learned_addr learned my addr 172.21.15.129:0/3276710166 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9852f00700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f984c149040 0x7f984c14b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:23.153 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f985149d700 1 --2- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6791/0 conn(0x7f984c05edd0 0x7f984c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9852f00700 1 --2- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6790/0 conn(0x7f984c149040 0x7f984c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806302832 0 0) 0x7f984c098000 con 0x7f984c0a6870 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f983c003230 con 0x7f984c0a6870 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4209330 0 0) 0x7f983c003230 con 0x7f984c0a6870 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6791/0 conn(0x7f984c05edd0 msgr2=0x7f984c05e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 --2- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6791/0 conn(0x7f984c05edd0 0x7f984c05e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6790/0 conn(0x7f984c149040 msgr2=0x7f984c14b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:23.154 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 --2- 172.21.15.129:0/3276710166 >> v2:172.21.15.129:6790/0 conn(0x7f984c149040 0x7f984c14b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c14c9e0 con 0x7f984c0a6870 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9838001710 con 0x7f984c0a6870 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 >> v1:172.21.15.129:6789/0 conn(0x7f984c0a6870 legacy=0x7f984c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f983c003230 con 0x7f983c003860 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f984c098000 con 0x7f983c00a310 2020-01-26T15:29:23.155 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c05e050 con 0x7f983c0077d0 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593270879 0 0) 0x7f984c098000 con 0x7f983c00a310 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f983c00e2e0 con 0x7f983c00a310 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933550538 0 0) 0x7f983c003230 con 0x7f983c003860 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c098000 con 0x7f983c003860 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 -- 172.21.15.129:0/3276710166 >> v1:172.21.15.129:6791/0 conn(0x7f983c00a310 legacy=0x7f983c00c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.156 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 -- 172.21.15.129:0/3276710166 >> v1:172.21.15.129:6790/0 conn(0x7f983c003860 legacy=0x7f983c003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9852f00700 1 -- 172.21.15.129:0/3276710166 reap_dead start 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 -- 172.21.15.129:0/3276710166 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c054470 con 0x7f983c0077d0 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9838001000 tx=0x7f983800c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9838001000 tx=0x7f983800c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f9838001000 tx=0x7f983800c2c0).ready entity=mon.0 client_cookie=971063f10de39d29 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f9838001000 tx=0x7f983800c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:23.157 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9838005940 con 0x7f983c0077d0 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f9838001000 tx=0x7f983800c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838005b40 con 0x7f983c0077d0 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9850c9c700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f9838001000 tx=0x7f983800c2c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f984bfff700 1 -- 172.21.15.129:0/3276710166 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f9838010160 con 0x7f983c0077d0 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 -- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 msgr2=0x7f983c009c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.143+0000 7f9851c9e700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f9838001000 tx=0x7f983800c2c0).stop 2020-01-26T15:29:23.158 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/3276710166 shutdown_connections 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 --2- 172.21.15.129:0/3276710166 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f983c0077d0 0x7f983c009c90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/3276710166 >> 172.21.15.129:0/3276710166 conn(0x7f984c098e70 msgr2=0x7f984c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/3276710166 shutdown_connections 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/3276710166 wait complete. 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 Processor -- start 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- start start 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 0x7f984c120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:23.159 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 0x7f984c13adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c1228d0 con 0x7f984c1224a0 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f984c120e90 con 0x7f984c138980 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f984c07d5a0 con 0x7f984c121560 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f985149d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f984c1224a0 0x7f984c120140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47724/0 (socket says 172.21.15.129:47724) 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f985149d700 1 -- 172.21.15.129:0/925422775 learned_addr learned my addr 172.21.15.129:0/925422775 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9850c9c700 -1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 0x7f984c120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:23.160 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9852f00700 -1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 0x7f984c13adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9850c9c700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 0x7f984c120940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9852f00700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 0x7f984c13adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069607025 0 0) 0x7f984c1228d0 con 0x7f984c1224a0 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982c003230 con 0x7f984c1224a0 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3921274417 0 0) 0x7f982c003230 con 0x7f984c1224a0 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f984c1228d0 con 0x7f984c1224a0 2020-01-26T15:29:23.161 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f9840001ab0 con 0x7f984c1224a0 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2713672295 0 0) 0x7f984c1228d0 con 0x7f984c1224a0 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 msgr2=0x7f984c120940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 0x7f984c120940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 msgr2=0x7f984c13adc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 0x7f984c13adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:23.162 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c121990 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c07c6a0 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c123eb0 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9840001ec0 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.147+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f98400022a0 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.151+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9824003360 con 0x7f984c1224a0 2020-01-26T15:29:23.163 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.151+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f9840002520 con 0x7f984c1224a0 2020-01-26T15:29:23.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.151+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(36..36 src has 1..36) v4 ==== 3387+0+0 (unknown 1186645116 0 0) 0x7f984004be40 con 0x7f984c1224a0 2020-01-26T15:29:23.164 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.155+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f9840031100 con 0x7f984c1224a0 2020-01-26T15:29:23.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.307+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f98240037d0 con 0x7f984c1224a0 2020-01-26T15:29:23.310 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.307+0000 7f9849ffb700 1 -- 172.21.15.129:0/925422775 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f9840031360 con 0x7f984c1224a0 2020-01-26T15:29:23.310 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:23.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 >> v1:172.21.15.129:6800/16899 conn(0x7f982c03e040 legacy=0x7f982c040550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 >> v1:172.21.15.129:6791/0 conn(0x7f984c1224a0 legacy=0x7f984c120140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:23.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 shutdown_connections 2020-01-26T15:29:23.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6790/0 conn(0x7f984c138980 0x7f984c13adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:23.312 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 --2- 172.21.15.129:0/925422775 >> v2:172.21.15.129:6791/0 conn(0x7f984c121560 0x7f984c120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:23.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 >> 172.21.15.129:0/925422775 conn(0x7f984c0a41d0 msgr2=0x7f984c05eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:23.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 shutdown_connections 2020-01-26T15:29:23.313 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:23.311+0000 7f9851c9e700 1 -- 172.21.15.129:0/925422775 wait complete. 2020-01-26T15:29:23.323 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:26.324 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:26.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 Processor -- start 2020-01-26T15:29:26.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 -- start start 2020-01-26T15:29:26.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 0x7f802814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:26.449 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80280a5b80 con 0x7f8028146c30 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8028080440 con 0x7f80280a5750 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802d24b700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f80280a43f0 con 0x7f802814a880 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802ca4a700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 0x7f802814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802759e700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f80280a5750 0x7f80280a4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47734/0 (socket says 172.21.15.129:47734) 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802759e700 1 -- 172.21.15.129:0/567393236 learned_addr learned my addr 172.21.15.129:0/567393236 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:26.450 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f801ed9d700 1 --1- 172.21.15.129:0/567393236 >> v1:172.21.15.129:6790/0 conn(0x7f8028146c30 0x7f8028149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50116/0 (socket says 172.21.15.129:50116) 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f802ca4a700 1 --2- 172.21.15.129:0/567393236 >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 0x7f802814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789570892 0 0) 0x7f8028080440 con 0x7f80280a5750 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8014003230 con 0x7f80280a5750 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397032807 0 0) 0x7f80280a5b80 con 0x7f8028146c30 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.443+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028080440 con 0x7f8028146c30 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3861717278 0 0) 0x7f8014003230 con 0x7f80280a5750 2020-01-26T15:29:26.451 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 msgr2=0x7f802814ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 --2- 172.21.15.129:0/567393236 >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 0x7f802814ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 >> v1:172.21.15.129:6790/0 conn(0x7f8028146c30 legacy=0x7f8028149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80280a4e00 con 0x7f80280a5750 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8018001710 con 0x7f80280a5750 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f80180019e0 con 0x7f80280a5750 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f8026d9d700 1 -- 172.21.15.129:0/567393236 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f80180045b0 con 0x7f80280a5750 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- 172.21.15.129:0/567393236 >> v1:172.21.15.129:6791/0 conn(0x7f80280a5750 legacy=0x7f80280a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.452 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- 172.21.15.129:0/567393236 shutdown_connections 2020-01-26T15:29:26.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 --2- 172.21.15.129:0/567393236 >> v2:172.21.15.129:6790/0 conn(0x7f802814a880 0x7f802814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:26.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- 172.21.15.129:0/567393236 >> 172.21.15.129:0/567393236 conn(0x7f802805e050 msgr2=0x7f8028098160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:26.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- 172.21.15.129:0/567393236 shutdown_connections 2020-01-26T15:29:26.453 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- 172.21.15.129:0/567393236 wait complete. 2020-01-26T15:29:26.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 Processor -- start 2020-01-26T15:29:26.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.447+0000 7f802d24b700 1 -- start start 2020-01-26T15:29:26.457 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802d24b700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8028066100 con 0x7f80280961d0 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802d24b700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8028062430 con 0x7f80281373f0 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802d24b700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8028096b90 con 0x7f80281215e0 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f801ed9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f80281215e0 0x7f802807ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47740/0 (socket says 172.21.15.129:47740) 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7f80281373f0 0x7f8028139830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50126/0 (socket says 172.21.15.129:50126) 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f801ed9d700 1 -- 172.21.15.129:0/2835941170 learned_addr learned my addr 172.21.15.129:0/2835941170 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201291772 0 0) 0x7f8028062430 con 0x7f80281373f0 2020-01-26T15:29:26.458 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003230 con 0x7f80281373f0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120661411 0 0) 0x7f8028096b90 con 0x7f80281215e0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028062430 con 0x7f80281215e0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819567498 0 0) 0x7f8028066100 con 0x7f80280961d0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8028096b90 con 0x7f80280961d0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4255407257 0 0) 0x7f800c003230 con 0x7f80281373f0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8028066100 con 0x7f80281373f0 2020-01-26T15:29:26.459 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f80200019e0 con 0x7f80281373f0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3481195533 0 0) 0x7f8028096b90 con 0x7f80280961d0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f800c003230 con 0x7f80280961d0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3318909518 0 0) 0x7f8028062430 con 0x7f80281215e0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8028096b90 con 0x7f80281215e0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f8018001420 con 0x7f80280961d0 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6791/0 conn(0x7f80281215e0 legacy=0x7f802807ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.460 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6790/0 conn(0x7f80281373f0 legacy=0x7f8028139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6789/0 conn(0x7f80280961d0 legacy=0x7f8028062fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8028066100 con 0x7f800c003540 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f8028062430 con 0x7f800c0087e0 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c010de0 con 0x7f800c00c430 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:26.461 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6791/0 conn(0x7f800c0087e0 legacy=0x7f800c00ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6790/0 conn(0x7f800c003540 legacy=0x7f800c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=4+}) v3 -- 0x7f802807f790 con 0x7f800c00c430 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8028096790 con 0x7f800c00c430 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80281215e0 con 0x7f800c00c430 2020-01-26T15:29:26.462 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f8020005c90 con 0x7f800c00c430 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.451+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000d230 con 0x7f800c00c430 2020-01-26T15:29:26.463 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.455+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.455+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f802000d420 con 0x7f800c00c430 2020-01-26T15:29:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.455+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.455+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000003360 con 0x7f800c00c430 2020-01-26T15:29:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.455+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 4 ==== osd_map(37..37 src has 1..37) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f802004db80 con 0x7f800c00c430 2020-01-26T15:29:26.464 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.463+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.465 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.463+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 5 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f8020033d50 con 0x7f800c00c430 2020-01-26T15:29:26.614 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.611+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8000003790 con 0x7f800c00c430 2020-01-26T15:29:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.611+0000 7f802ca4a700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:26.615 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.611+0000 7f8024d99700 1 -- 172.21.15.129:0/2835941170 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f8020033fb0 con 0x7f800c00c430 2020-01-26T15:29:26.615 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 >> v1:172.21.15.129:6800/16899 conn(0x7f800c0489f0 legacy=0x7f800c04af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 msgr2=0x7f800c00e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:26.616 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 --2- 172.21.15.129:0/2835941170 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f800c00c430 0x7f800c00e870 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f8020001320 tx=0x7f8020011a30).stop 2020-01-26T15:29:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802ca4a700 1 -- 172.21.15.129:0/2835941170 reap_dead start 2020-01-26T15:29:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 shutdown_connections 2020-01-26T15:29:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 >> 172.21.15.129:0/2835941170 conn(0x7f80280a6b80 msgr2=0x7f8028123e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 shutdown_connections 2020-01-26T15:29:26.617 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:26.615+0000 7f802d24b700 1 -- 172.21.15.129:0/2835941170 wait complete. 2020-01-26T15:29:26.627 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:29.628 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 Processor -- start 2020-01-26T15:29:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 -- start start 2020-01-26T15:29:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0bb805e5f0 0x7f0bb80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80a6dc0 con 0x7f0bb805edd0 2020-01-26T15:29:29.755 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb805ea20 con 0x7f0bb8149040 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb759e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb8098000 con 0x7f0bb805e5f0 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb659c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f0bb805e5f0 0x7f0bb80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bbc84a700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f0bb8149040 0x7f0bb814b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47756/0 (socket says 172.21.15.129:47756) 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bbc84a700 1 -- 172.21.15.129:0/1202906525 learned_addr learned my addr 172.21.15.129:0/1202906525 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb6d9d700 1 --1- 172.21.15.129:0/1202906525 >> v1:172.21.15.129:6789/0 conn(0x7f0bb805edd0 0x7f0bb807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41836/0 (socket says 172.21.15.129:41836) 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb659c700 1 --2- 172.21.15.129:0/1202906525 >> v2:172.21.15.129:6790/0 conn(0x7f0bb805e5f0 0x7f0bb80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:29.756 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12378503 0 0) 0x7f0bb80a6dc0 con 0x7f0bb805edd0 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba4003230 con 0x7f0bb805edd0 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468767836 0 0) 0x7f0bb805ea20 con 0x7f0bb8149040 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb80a6dc0 con 0x7f0bb8149040 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3763953502 0 0) 0x7f0ba4003230 con 0x7f0bb805edd0 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 >> v2:172.21.15.129:6790/0 conn(0x7f0bb805e5f0 msgr2=0x7f0bb80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 --2- 172.21.15.129:0/1202906525 >> v2:172.21.15.129:6790/0 conn(0x7f0bb805e5f0 0x7f0bb80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:29.757 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 >> v1:172.21.15.129:6791/0 conn(0x7f0bb8149040 legacy=0x7f0bb814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb805e050 con 0x7f0bb805edd0 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba0001710 con 0x7f0bb805edd0 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 >> v1:172.21.15.129:6789/0 conn(0x7f0bb805edd0 legacy=0x7f0bb807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 --2- 172.21.15.129:0/1202906525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ba4004f70 0x7f0ba4003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0ba4003230 con 0x7f0ba400a7f0 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f0bb805ea20 con 0x7f0ba4004b20 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8098000 con 0x7f0ba4004f70 2020-01-26T15:29:29.758 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb659c700 1 --2- 172.21.15.129:0/1202906525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ba4004f70 0x7f0ba4003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566347615 0 0) 0x7f0bb805ea20 con 0x7f0ba4004b20 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba400e440 con 0x7f0ba4004b20 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309349979 0 0) 0x7f0ba4003230 con 0x7f0ba400a7f0 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb805ea20 con 0x7f0ba400a7f0 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 590381876 0 0) 0x7f0ba400e440 con 0x7f0ba4004b20 2020-01-26T15:29:29.759 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ba4004f70 msgr2=0x7f0ba4003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 --2- 172.21.15.129:0/1202906525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ba4004f70 0x7f0ba4003d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 >> v1:172.21.15.129:6790/0 conn(0x7f0ba400a7f0 legacy=0x7f0ba400cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4054580 con 0x7f0ba4004b20 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba00046a0 con 0x7f0ba4004b20 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.747+0000 7f0bb659c700 1 --2- 172.21.15.129:0/1202906525 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f0ba4004f70 0x7f0ba4003d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ba00048a0 con 0x7f0ba4004b20 2020-01-26T15:29:29.760 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb5d9b700 1 -- 172.21.15.129:0/1202906525 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba0004d00 con 0x7f0ba4004b20 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 -- 172.21.15.129:0/1202906525 >> v1:172.21.15.129:6791/0 conn(0x7f0ba4004b20 legacy=0x7f0ba4003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bbc84a700 1 -- 172.21.15.129:0/1202906525 reap_dead start 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 -- 172.21.15.129:0/1202906525 shutdown_connections 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 -- 172.21.15.129:0/1202906525 >> 172.21.15.129:0/1202906525 conn(0x7f0bb8098e70 msgr2=0x7f0bb80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 -- 172.21.15.129:0/1202906525 shutdown_connections 2020-01-26T15:29:29.761 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 -- 172.21.15.129:0/1202906525 wait complete. 2020-01-26T15:29:29.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.751+0000 7f0bb759e700 1 Processor -- start 2020-01-26T15:29:29.765 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- start start 2020-01-26T15:29:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80a1950 con 0x7f0bb8137580 2020-01-26T15:29:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb807d5a0 con 0x7f0bb807d170 2020-01-26T15:29:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb807b290 con 0x7f0bb80a1200 2020-01-26T15:29:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb6d9d700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f0bb80a1200 0x7f0bb807aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47764/0 (socket says 172.21.15.129:47764) 2020-01-26T15:29:29.766 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb6d9d700 1 -- 172.21.15.129:0/1224631764 learned_addr learned my addr 172.21.15.129:0/1224631764 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587398795 0 0) 0x7f0bb807b290 con 0x7f0bb80a1200 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c003230 con 0x7f0bb80a1200 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633165762 0 0) 0x7f0bb807d5a0 con 0x7f0bb807d170 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb807b290 con 0x7f0bb807d170 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816712574 0 0) 0x7f0bb80a1950 con 0x7f0bb8137580 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb807d5a0 con 0x7f0bb8137580 2020-01-26T15:29:29.767 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 129894806 0 0) 0x7f0b9c003230 con 0x7f0bb80a1200 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0bb80a1950 con 0x7f0bb80a1200 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba00044f0 con 0x7f0bb80a1200 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1213111145 0 0) 0x7f0bb807b290 con 0x7f0bb807d170 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b9c003230 con 0x7f0bb807d170 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba8005b70 con 0x7f0bb807d170 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3840036318 0 0) 0x7f0bb807d5a0 con 0x7f0bb8137580 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0bb807b290 con 0x7f0bb8137580 2020-01-26T15:29:29.768 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 438489853 0 0) 0x7f0bb80a1950 con 0x7f0bb80a1200 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 >> v1:172.21.15.129:6790/0 conn(0x7f0bb807d170 legacy=0x7f0bb8079e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 >> v1:172.21.15.129:6789/0 conn(0x7f0bb8137580 legacy=0x7f0bb81399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8123030 con 0x7f0bb80a1200 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb807d8f0 con 0x7f0bb80a1200 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb807a670 con 0x7f0bb80a1200 2020-01-26T15:29:29.769 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ba0004a20 con 0x7f0bb80a1200 2020-01-26T15:29:29.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.755+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f0ba0004e40 con 0x7f0bb80a1200 2020-01-26T15:29:29.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.759+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8056600 con 0x7f0bb80a1200 2020-01-26T15:29:29.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.759+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7f0ba00050c0 con 0x7f0bb80a1200 2020-01-26T15:29:29.770 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.759+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 8 ==== osd_map(37..37 src has 1..37) v4 ==== 3387+0+0 (unknown 2660669470 0 0) 0x7f0ba004ba20 con 0x7f0bb80a1200 2020-01-26T15:29:29.771 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.763+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7f0ba0031060 con 0x7f0bb80a1200 2020-01-26T15:29:29.919 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 --> v1:172.21.15.129:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0bb805cc60 con 0x7f0bb80a1200 2020-01-26T15:29:29.920 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0baf7fe700 1 -- 172.21.15.129:0/1224631764 <== mon.2 v1:172.21.15.129:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7f0ba0031c10 con 0x7f0bb80a1200 2020-01-26T15:29:29.920 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 >> v1:172.21.15.129:6800/16899 conn(0x7f0b9c03e770 legacy=0x7f0b9c040c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 >> v1:172.21.15.129:6791/0 conn(0x7f0bb80a1200 legacy=0x7f0bb807aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 shutdown_connections 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 >> 172.21.15.129:0/1224631764 conn(0x7f0bb80970e0 msgr2=0x7f0bb8122400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 shutdown_connections 2020-01-26T15:29:29.922 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:29.919+0000 7f0bb759e700 1 -- 172.21.15.129:0/1224631764 wait complete. 2020-01-26T15:29:29.933 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:32.934 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 Processor -- start 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 -- start start 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fbf4c0a6870 0x7fbf4c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c05ea20 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c098000 con 0x7fbf4c05edd0 2020-01-26T15:29:33.061 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4bfff700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c05e050 con 0x7fbf4c0a6870 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4b7fe700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7fbf4c05edd0 0x7fbf4c07ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47772/0 (socket says 172.21.15.129:47772) 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf4b7fe700 1 -- 172.21.15.129:0/80817091 learned_addr learned my addr 172.21.15.129:0/80817091 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf513e8700 -1 --2- 172.21.15.129:0/80817091 >> v2:172.21.15.129:6791/0 conn(0x7fbf4c0a6870 0x7fbf4c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.047+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> v2:172.21.15.129:6791/0 conn(0x7fbf4c0a6870 0x7fbf4c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195569112 0 0) 0x7fbf4c05ea20 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf38003230 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.062 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414044743 0 0) 0x7fbf4c098000 con 0x7fbf4c05edd0 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c05ea20 con 0x7fbf4c05edd0 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3339693620 0 0) 0x7fbf38003230 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 >> v2:172.21.15.129:6791/0 conn(0x7fbf4c0a6870 msgr2=0x7fbf4c14c860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 --2- 172.21.15.129:0/80817091 >> v2:172.21.15.129:6791/0 conn(0x7fbf4c0a6870 0x7fbf4c14c860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 >> v1:172.21.15.129:6791/0 conn(0x7fbf4c05edd0 legacy=0x7fbf4c07ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0a6ca0 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.063 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbf34001710 con 0x7fbf4c05e5f0 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 >> v1:172.21.15.129:6789/0 conn(0x7fbf4c05e5f0 legacy=0x7fbf4c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbf38003230 con 0x7fbf38004f70 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbf4c098000 con 0x7fbf38004b20 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c05e050 con 0x7fbf3800b800 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261893309 0 0) 0x7fbf4c098000 con 0x7fbf38004b20 2020-01-26T15:29:33.064 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf3800f340 con 0x7fbf38004b20 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112014002 0 0) 0x7fbf38003230 con 0x7fbf38004f70 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c098000 con 0x7fbf38004f70 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 -- 172.21.15.129:0/80817091 >> v1:172.21.15.129:6791/0 conn(0x7fbf38004b20 legacy=0x7fbf38003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 -- 172.21.15.129:0/80817091 >> v1:172.21.15.129:6790/0 conn(0x7fbf38004f70 legacy=0x7fbf38003d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 -- 172.21.15.129:0/80817091 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38010570 con 0x7fbf3800b800 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf44002f30 tx=0x7fbf44053e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.065 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf44002f30 tx=0x7fbf44053e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fbf44002f30 tx=0x7fbf44053e50).ready entity=mon.0 client_cookie=ef9542522218e997 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:33.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fbf44002f30 tx=0x7fbf44053e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbf4404ab00 con 0x7fbf3800b800 2020-01-26T15:29:33.066 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fbf44002f30 tx=0x7fbf44053e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4404ad00 con 0x7fbf3800b800 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fbf44002f30 tx=0x7fbf44053e50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 -- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 msgr2=0x7fbf3800dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4a7fc700 1 -- 172.21.15.129:0/80817091 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbf44054910 con 0x7fbf3800b800 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 --2- 172.21.15.129:0/80817091 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf3800b800 0x7fbf3800dc60 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fbf44002f30 tx=0x7fbf44053e50).stop 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf513e8700 1 -- 172.21.15.129:0/80817091 reap_dead start 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 -- 172.21.15.129:0/80817091 shutdown_connections 2020-01-26T15:29:33.067 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 -- 172.21.15.129:0/80817091 >> 172.21.15.129:0/80817091 conn(0x7fbf4c098e70 msgr2=0x7fbf4c0a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 -- 172.21.15.129:0/80817091 shutdown_connections 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.051+0000 7fbf4bfff700 1 -- 172.21.15.129:0/80817091 wait complete. 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4bfff700 1 Processor -- start 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4bfff700 1 -- start start 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4bfff700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c09e2e0 con 0x7fbf4c130bf0 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4bfff700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c076a70 con 0x7fbf4c12ffc0 2020-01-26T15:29:33.068 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4bfff700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c097630 con 0x7fbf4c11feb0 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf513e8700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fbf4c130bf0 0x7fbf4c13bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41872/0 (socket says 172.21.15.129:41872) 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf513e8700 1 -- 172.21.15.129:0/1085436615 learned_addr learned my addr 172.21.15.129:0/1085436615 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4affd700 1 --1- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6790/0 conn(0x7fbf4c12ffc0 0x7fbf4c1303f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50168/0 (socket says 172.21.15.129:50168) 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95608099 0 0) 0x7fbf44000e00 con 0x7fbf4c130bf0 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf30003230 con 0x7fbf4c130bf0 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543317613 0 0) 0x7fbf4c097630 con 0x7fbf4c11feb0 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf44000e00 con 0x7fbf4c11feb0 2020-01-26T15:29:33.069 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087345623 0 0) 0x7fbf4c076a70 con 0x7fbf4c12ffc0 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c097630 con 0x7fbf4c12ffc0 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3814615115 0 0) 0x7fbf30003230 con 0x7fbf4c130bf0 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf4c076a70 con 0x7fbf4c130bf0 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fbf44054760 con 0x7fbf4c130bf0 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6791/0 conn(0x7fbf4c11feb0 legacy=0x7fbf4c11e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6790/0 conn(0x7fbf4c12ffc0 legacy=0x7fbf4c1303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.070 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6789/0 conn(0x7fbf4c130bf0 legacy=0x7fbf4c13bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbf4c097630 con 0x7fbf30004f20 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fbf30003230 con 0x7fbf30004af0 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30005350 con 0x7fbf30003e60 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.055+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023883193 0 0) 0x7fbf30003230 con 0x7fbf30004af0 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf3000e810 con 0x7fbf30004af0 2020-01-26T15:29:33.071 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6791/0 conn(0x7fbf30004af0 legacy=0x7fbf300097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6790/0 conn(0x7fbf30004f20 legacy=0x7fbf3000d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c11f240 con 0x7fbf30003e60 2020-01-26T15:29:33.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c11feb0 con 0x7fbf30003e60 2020-01-26T15:29:33.072 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c11e330 con 0x7fbf30003e60 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbf3c004930 con 0x7fbf30003e60 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c004b30 con 0x7fbf30003e60 2020-01-26T15:29:33.073 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fbf3c006180 con 0x7fbf30003e60 2020-01-26T15:29:33.074 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7fbf3c0063d0 con 0x7fbf30003e60 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf24003360 con 0x7fbf30003e60 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.059+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (secure 0 0 0) 0x7fbf3c04d3c0 con 0x7fbf30003e60 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.063+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.075 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.063+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7fbf3c033750 con 0x7fbf30003e60 2020-01-26T15:29:33.223 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.219+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf24003790 con 0x7fbf30003e60 2020-01-26T15:29:33.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4b7fe700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:33.224 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf43fff700 1 -- 172.21.15.129:0/1085436615 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7fbf3c034de0 con 0x7fbf30003e60 2020-01-26T15:29:33.224 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:33.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 >> v1:172.21.15.129:6800/16899 conn(0x7fbf30048270 legacy=0x7fbf3004a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 msgr2=0x7fbf300045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:33.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 --2- 172.21.15.129:0/1085436615 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fbf30003e60 0x7fbf300045a0 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fbf3c001340 tx=0x7fbf3c011040).stop 2020-01-26T15:29:33.225 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf513e8700 1 -- 172.21.15.129:0/1085436615 reap_dead start 2020-01-26T15:29:33.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 shutdown_connections 2020-01-26T15:29:33.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 >> 172.21.15.129:0/1085436615 conn(0x7fbf4c0a7c30 msgr2=0x7fbf4c07f140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:33.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 shutdown_connections 2020-01-26T15:29:33.226 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:33.223+0000 7fbf4bfff700 1 -- 172.21.15.129:0/1085436615 wait complete. 2020-01-26T15:29:33.236 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:36.237 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:36.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 Processor -- start 2020-01-26T15:29:36.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 -- start start 2020-01-26T15:29:36.354 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 0x7f26f80a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 0x7f26f814b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80a6dc0 con 0x7f26f805edd0 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7f26f805ea20 con 0x7f26f8149040 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fcd65700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f26f8098000 con 0x7f26f805e5f0 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f7fff700 1 --1- >> v1:172.21.15.129:6791/0 conn(0x7f26f805edd0 0x7f26f807ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47798/0 (socket says 172.21.15.129:47798) 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f7fff700 1 -- 172.21.15.129:0/1241066231 learned_addr learned my addr 172.21.15.129:0/1241066231 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:36.355 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fdfc7700 -1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 0x7f26f814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f77fe700 -1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 0x7f26f80a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26fdfc7700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 0x7f26f814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f77fe700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 0x7f26f80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539717328 0 0) 0x7f26f80a6dc0 con 0x7f26f805edd0 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.346+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e0003230 con 0x7f26f805edd0 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1653266111 0 0) 0x7f26e0003230 con 0x7f26f805edd0 2020-01-26T15:29:36.356 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 msgr2=0x7f26f80a6870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 0x7f26f80a6870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 msgr2=0x7f26f814b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 0x7f26f814b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 --> v1:172.21.15.129:6791/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f805e050 con 0x7f26f805edd0 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 <== mon.2 v1:172.21.15.129:6791/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f26e8001710 con 0x7f26f805edd0 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 <== mon.2 v1:172.21.15.129:6791/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f26e8001aa0 con 0x7f26f805edd0 2020-01-26T15:29:36.357 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- 172.21.15.129:0/1241066231 >> v1:172.21.15.129:6791/0 conn(0x7f26f805edd0 legacy=0x7f26f807ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26f6ffd700 1 -- 172.21.15.129:0/1241066231 <== mon.2 v1:172.21.15.129:6791/0 5 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f26e8004760 con 0x7f26f805edd0 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- 172.21.15.129:0/1241066231 shutdown_connections 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6790/0 conn(0x7f26f8149040 0x7f26f814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 --2- 172.21.15.129:0/1241066231 >> v2:172.21.15.129:6791/0 conn(0x7f26f805e5f0 0x7f26f80a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- 172.21.15.129:0/1241066231 >> 172.21.15.129:0/1241066231 conn(0x7f26f8098e70 msgr2=0x7f26f80a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- 172.21.15.129:0/1241066231 shutdown_connections 2020-01-26T15:29:36.358 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- 172.21.15.129:0/1241066231 wait complete. 2020-01-26T15:29:36.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 Processor -- start 2020-01-26T15:29:36.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.350+0000 7f26fcd65700 1 -- start start 2020-01-26T15:29:36.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f26f8078dd0 0x7f26f8079200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:36.363 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f8079ff0 con 0x7f26f8138540 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f8079750 con 0x7f26f8079bc0 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7f26f81201f0 con 0x7f26f8078dd0 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fdfc7700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7f26f8138540 0x7f26f813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41892/0 (socket says 172.21.15.129:41892) 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7f26f8078dd0 0x7f26f8079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fdfc7700 1 -- 172.21.15.129:0/3927575571 learned_addr learned my addr 172.21.15.129:0/3927575571 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:36.364 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> v2:172.21.15.129:6791/0 conn(0x7f26f8078dd0 0x7f26f8079200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132663023 0 0) 0x7f26f8079750 con 0x7f26f8079bc0 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d8003230 con 0x7f26f8079bc0 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895919973 0 0) 0x7f26f0001260 con 0x7f26f8138540 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f8079750 con 0x7f26f8138540 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 287493168 0 0) 0x7f26f8079750 con 0x7f26f8138540 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26f0001260 con 0x7f26f8138540 2020-01-26T15:29:36.365 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 313240508 0 0) 0x7f26d8003230 con 0x7f26f8079bc0 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26f8079750 con 0x7f26f8079bc0 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7f26f0001b90 con 0x7f26f8138540 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 >> v2:172.21.15.129:6791/0 conn(0x7f26f8078dd0 msgr2=0x7f26f8079200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 --2- 172.21.15.129:0/3927575571 >> v2:172.21.15.129:6791/0 conn(0x7f26f8078dd0 0x7f26f8079200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 >> v1:172.21.15.129:6790/0 conn(0x7f26f8079bc0 legacy=0x7f26f80a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 >> v1:172.21.15.129:6789/0 conn(0x7f26f8138540 legacy=0x7f26f813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.366 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f26d8003230 con 0x7f26d8004fd0 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7f26d800f9a0 con 0x7f26d800ad40 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f81201f0 con 0x7f26d8003d40 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637211986 0 0) 0x7f26d800f9a0 con 0x7f26d800ad40 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d800e990 con 0x7f26d800ad40 2020-01-26T15:29:36.367 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461399468 0 0) 0x7f26d8003230 con 0x7f26d8004fd0 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d800f9a0 con 0x7f26d8004fd0 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 -- 172.21.15.129:0/3927575571 >> v1:172.21.15.129:6791/0 conn(0x7f26d800ad40 legacy=0x7f26d800d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.2 v1:172.21.15.129:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3250238917 0 0) 0x7f26d800e990 con 0x7f26d800ad40 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 -- 172.21.15.129:0/3927575571 >> v1:172.21.15.129:6790/0 conn(0x7f26d8004fd0 legacy=0x7f26d8003540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f8097bc0 con 0x7f26d8003d40 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f80a3540 con 0x7f26d8003d40 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f807a2d0 con 0x7f26d8003d40 2020-01-26T15:29:36.368 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f26e8001670 con 0x7f26d8003d40 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.369 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec005780 con 0x7f26d8003d40 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7f26ec005b20 con 0x7f26d8003d40 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.354+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d0003360 con 0x7f26d8003d40 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.358+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 4 ==== mgrmap(e 7) v1 ==== 47155+0+0 (secure 0 0 0) 0x7f26ec0112f0 con 0x7f26d8003d40 2020-01-26T15:29:36.370 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.358+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.358+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (secure 0 0 0) 0x7f26ec04ca10 con 0x7f26d8003d40 2020-01-26T15:29:36.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.362+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.371 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.362+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (secure 0 0 0) 0x7f26ec032b60 con 0x7f26d8003d40 2020-01-26T15:29:36.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.518+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26d0003790 con 0x7f26d8003d40 2020-01-26T15:29:36.523 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.518+0000 7f26f77fe700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:36.524 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.518+0000 7f26f4ff9700 1 -- 172.21.15.129:0/3927575571 <== mon.0 v2:172.21.15.129:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (secure 0 0 0) 0x7f26ec032dc0 con 0x7f26d8003d40 2020-01-26T15:29:36.524 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:36.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 >> v1:172.21.15.129:6800/16899 conn(0x7f26d8051140 legacy=0x7f26d8053650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fdfc7700 1 -- 172.21.15.129:0/3927575571 reap_dead start 2020-01-26T15:29:36.525 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 msgr2=0x7f26d800a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7f26e80018b0 tx=0x7f26e80048a0).stop 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 shutdown_connections 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 --2- 172.21.15.129:0/3927575571 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7f26d8003d40 0x7f26d800a7f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 >> 172.21.15.129:0/3927575571 conn(0x7f26f805c110 msgr2=0x7f26f80a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 shutdown_connections 2020-01-26T15:29:36.526 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:36.522+0000 7f26fcd65700 1 -- 172.21.15.129:0/3927575571 wait complete. 2020-01-26T15:29:36.536 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:39.538 INFO:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 Processor -- start 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 -- start start 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd8f405edd0 0x7fd8f405e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 -- --> v1:172.21.15.129:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f4098000 con 0x7fd8f40a6870 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 -- --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f405e050 con 0x7fd8f4149040 2020-01-26T15:29:39.659 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40a6ca0 con 0x7fd8f405edd0 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f2d9d700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd8f405edd0 0x7fd8f405e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f2d9d700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd8f405edd0 0x7fd8f405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f259c700 1 --1- >> v1:172.21.15.129:6789/0 conn(0x7fd8f40a6870 0x7fd8f407ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6789/0 says I am v1:172.21.15.129:41906/0 (socket says 172.21.15.129:41906) 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f259c700 1 -- 172.21.15.129:0/660176434 learned_addr learned my addr 172.21.15.129:0/660176434 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f89df700 1 --1- 172.21.15.129:0/660176434 >> v1:172.21.15.129:6791/0 conn(0x7fd8f4149040 0x7fd8f414b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.129:6791/0 says I am v1:172.21.15.129:47820/0 (socket says 172.21.15.129:47820) 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v1:172.21.15.129:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070846209 0 0) 0x7fd8f4098000 con 0x7fd8f40a6870 2020-01-26T15:29:39.660 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e0003230 con 0x7fd8f40a6870 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.2 v1:172.21.15.129:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975345043 0 0) 0x7fd8f405e050 con 0x7fd8f4149040 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6791/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f4098000 con 0x7fd8f4149040 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v1:172.21.15.129:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1896263787 0 0) 0x7fd8e0003230 con 0x7fd8f40a6870 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 >> v2:172.21.15.129:6790/0 conn(0x7fd8f405edd0 msgr2=0x7fd8f405e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 --2- 172.21.15.129:0/660176434 >> v2:172.21.15.129:6790/0 conn(0x7fd8f405edd0 0x7fd8f405e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 >> v1:172.21.15.129:6791/0 conn(0x7fd8f4149040 legacy=0x7fd8f414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.661 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f414ecb0 con 0x7fd8f40a6870 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v1:172.21.15.129:6789/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd8dc001710 con 0x7fd8f40a6870 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 >> v1:172.21.15.129:6789/0 conn(0x7fd8f40a6870 legacy=0x7fd8f407ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd8e0003230 con 0x7fd8e0003ac0 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6791/0 -- auth(proto 0 30 bytes epoch 3) v1 -- 0x7fd8f405e050 con 0x7fd8e000a7f0 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40a6ca0 con 0x7fd8e0003f30 2020-01-26T15:29:39.662 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.650+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600760549 0 0) 0x7fd8e0003230 con 0x7fd8e0003ac0 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e000e440 con 0x7fd8e0003ac0 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 -- 172.21.15.129:0/660176434 >> v1:172.21.15.129:6791/0 conn(0x7fd8e000a7f0 legacy=0x7fd8e000cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 -- 172.21.15.129:0/660176434 >> v1:172.21.15.129:6790/0 conn(0x7fd8e0003ac0 legacy=0x7fd8e00045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 -- 172.21.15.129:0/660176434 --> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0054530 con 0x7fd8e0003f30 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:39.663 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).ready entity=mon.0 client_cookie=ca198babfddec383 server_cookie=0 in_seq=0 out_seq=0 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v2:172.21.15.129:3300/0 1 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd8dc010310 con 0x7fd8e0003f30 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v2:172.21.15.129:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc010510 con 0x7fd8e0003f30 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f259c700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-01-26T15:29:39.664 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f1d9b700 1 -- 172.21.15.129:0/660176434 <== mon.0 v2:172.21.15.129:3300/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (secure 0 0 0) 0x7fd8dc0108b0 con 0x7fd8e0003f30 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 msgr2=0x7fd8e0004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 --2- 172.21.15.129:0/660176434 >> [v2:172.21.15.129:3300/0,v1:172.21.15.129:6789/0] conn(0x7fd8e0003f30 0x7fd8e0004da0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd8dc001520 tx=0x7fd8dc00c210).stop 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f89df700 1 -- 172.21.15.129:0/660176434 reap_dead start 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- 172.21.15.129:0/660176434 shutdown_connections 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- 172.21.15.129:0/660176434 >> 172.21.15.129:0/660176434 conn(0x7fd8f4098e70 msgr2=0x7fd8f40a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- 172.21.15.129:0/660176434 shutdown_connections 2020-01-26T15:29:39.665 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- 172.21.15.129:0/660176434 wait complete. 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 Processor -- start 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.654+0000 7fd8f359e700 1 -- start start 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 0x7fd8f407cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 0x7fd8f413a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- --> v1:172.21.15.129:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f4098ec0 con 0x7fd8f4065290 2020-01-26T15:29:39.671 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- --> v2:172.21.15.129:6790/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f4064c90 con 0x7fd8f40a0340 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- --> v2:172.21.15.129:6791/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f4064760 con 0x7fd8f407d2e0 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f89df700 -1 --2- >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 0x7fd8f413a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6791/0 is using msgr V1 protocol 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f259c700 -1 --2- >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 0x7fd8f407cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner peer v2:172.21.15.129:6790/0 is using msgr V1 protocol 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f2d9d700 1 --1- >> v1:172.21.15.129:6790/0 conn(0x7fd8f4065290 0x7fd8f40a1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.129:6790/0 says I am v1:172.21.15.129:50214/0 (socket says 172.21.15.129:50214) 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f2d9d700 1 -- 172.21.15.129:0/3306402363 learned_addr learned my addr 172.21.15.129:0/3306402363 (peer_addr_for_me v1:172.21.15.129:0/0) 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f89df700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 0x7fd8f413a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:39.672 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f259c700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 0x7fd8f407cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0)._fault waiting 0.200000 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965025503 0 0) 0x7fd8f4098ec0 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d8003230 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1991569138 0 0) 0x7fd8d8003230 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd8f4098ec0 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 3 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd8e4002ad0 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3977780784 0 0) 0x7fd8f4098ec0 con 0x7fd8f4065290 2020-01-26T15:29:39.673 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 msgr2=0x7fd8f413a820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 0x7fd8f413a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 msgr2=0x7fd8f407cd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 0x7fd8f407cd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f407d710 con 0x7fd8f4065290 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40a1860 con 0x7fd8f4065290 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4123140 con 0x7fd8f4065290 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd8e4001420 con 0x7fd8f4065290 2020-01-26T15:29:39.674 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 6 ==== mon_map magic: 0 v1 ==== 313+0+0 (unknown 276300320 0 0) 0x7fd8e4001880 con 0x7fd8f4065290 2020-01-26T15:29:39.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.658+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4056600 con 0x7fd8f4065290 2020-01-26T15:29:39.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.662+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 7 ==== mgrmap(e 7) v1 ==== 47155+0+0 (unknown 2448299152 0 0) 0x7fd8e4001b00 con 0x7fd8f4065290 2020-01-26T15:29:39.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.662+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 8 ==== osd_map(38..38 src has 1..38) v4 ==== 3387+0+0 (unknown 4077783625 0 0) 0x7fd8e404bf10 con 0x7fd8f4065290 2020-01-26T15:29:39.675 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.666+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+116194 (unknown 1092875540 0 2223406054) 0x7fd8f4123140 con 0x7fd8f4065290 2020-01-26T15:29:39.823 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.818+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 --> v1:172.21.15.129:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd8f405c4e0 con 0x7fd8f4065290 2020-01-26T15:29:39.824 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8eb7fe700 1 -- 172.21.15.129:0/3306402363 <== mon.1 v1:172.21.15.129:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+160 (unknown 3730786198 0 3362477801) 0x7fd8e40313d0 con 0x7fd8f4065290 2020-01-26T15:29:39.824 INFO:teuthology.orchestra.run.smithi129.stdout: 2020-01-26T15:29:39.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 >> v1:172.21.15.129:6800/16899 conn(0x7fd8d803e050 legacy=0x7fd8d8040560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 >> v1:172.21.15.129:6790/0 conn(0x7fd8f4065290 legacy=0x7fd8f40a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-01-26T15:29:39.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 shutdown_connections 2020-01-26T15:29:39.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6791/0 conn(0x7fd8f407d2e0 0x7fd8f413a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:39.827 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 --2- 172.21.15.129:0/3306402363 >> v2:172.21.15.129:6790/0 conn(0x7fd8f40a0340 0x7fd8f407cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-01-26T15:29:39.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 >> 172.21.15.129:0/3306402363 conn(0x7fd8f405edd0 msgr2=0x7fd8f407f240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-01-26T15:29:39.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 shutdown_connections 2020-01-26T15:29:39.828 INFO:teuthology.orchestra.run.smithi129.stderr:2020-01-26T15:29:39.822+0000 7fd8f359e700 1 -- 172.21.15.129:0/3306402363 wait complete. 2020-01-26T15:29:39.845 INFO:teuthology.orchestra.run.smithi129.stdout:{"status":"HEALTH_WARN","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is degraded","count":1},"muted":false}},"mutes":[]} 2020-01-26T15:29:39.845 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 86, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/ceph.py", line 1480, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sage-testing-2020-01-26-0849/qa/tasks/ceph_manager.py", line 2876, in wait_until_healthy 'timeout expired in wait_until_healthy' AssertionError: timeout expired in wait_until_healthy 2020-01-26T15:29:39.847 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:29:39.859 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2020-01-26T15:29:39.873 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:29:39.889 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2020-01-26T15:29:39.908 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2020-01-26T15:29:39.923 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-01-26T15:29:39.949 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-01-26T15:29:39.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:29:39.949 INFO:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2020-01-26T15:29:39.949 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:29:39.960 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-01-26T15:29:39.960 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:29:39.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:29:39.961 INFO:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2020-01-26T15:29:39.961 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.1 2020-01-26T15:29:40.012 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-01-26T15:29:40.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-01-26T15:29:40.012 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2020-01-26T15:29:40.012 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-01-26T15:29:40.012 INFO:teuthology.orchestra.run.smithi042:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2020-01-26T15:29:40.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-01-26T15:29:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.1: Device or resource busy 2020-01-26T15:29:40.122 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi042.front.sepia.ceph.com, aborting... 2020-01-26T15:29:40.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-01-26T15:29:40.122 INFO:teuthology.orchestra.run.smithi042:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2020-01-26T15:44:40.130 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2020-01-26T15:44:40.141 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2020-01-27T03:03:07.823 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-01-27T03:03:07.840 DEBUG:teuthology.task.console_log:Killing console logger for smithi042 2020-01-27T03:03:07.841 DEBUG:teuthology.task.console_log:Killing console logger for smithi129 2020-01-27T03:03:07.841 DEBUG:teuthology.task.console_log:Killing console logger for smithi204 2020-01-27T03:03:07.841 DEBUG:teuthology.task.console_log:Killing console logger for smithi204 2020-01-27T03:03:07.841 DEBUG:teuthology.task.console_log:Killing console logger for smithi129 2020-01-27T03:03:07.842 DEBUG:teuthology.task.console_log:Killing console logger for smithi042 2020-01-27T03:03:07.842 DEBUG:teuthology.exit:Finished running handlers